Author Topic: Migrating BerliOS to SourceForge  (Read 17116 times)

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Migrating BerliOS to SourceForge
« on: June 06, 2014, 04:03:24 am »
I have been starting a few tests with with migration of the BerliOS dump files, and have run into what will likely be a major issue.  Attached files on SourceForge do not appear anywhere in the complete export.  They are only referenced by a url, but give no hint of how a file could be imported to that location.
Code
{
  "status": "open",
  "reported_by_id": "5124334124b0d9277e70766c",
  "related_artifacts": [],
  "attachments": [
    {
      "url": "http://sourceforge.net/p/ticketexport/patches/3/attachment/converterTest.py",
      "bytes": 921
    }
  ],
  "reported_by": "alpha0010",
  "description": "Extended description.",
  "labels": [],
  "assigned_to": "alpha0010",
  "assigned_to_id": "5124334124b0d9277e70766c",
  "private": false,
  "summary": "Ticket with patch",
  "discussion_thread": {
    "_id": "bc4d1a58",
    "posts": [],
    "discussion_id": "529d6ac0d46bb4611598533a",
    "subject": ""
  },
  "mod_date": "2014-06-06 01:34:22.120000",
  "votes_down": 0,
  "votes_up": 0,
  "_id": "53911a9df1fd8d55b0aeeeb3",
  "discussion_thread_url": "http://sourceforge.net/rest/p/ticketexport/patches/_discuss/thread/bc4d1a58/",
  "ticket_num": 3,
  "custom_fields": {
    "_milestone": "1.0"
  },
  "created_date": "2014-06-06 01:34:21.961000"
}

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Re: Migrating BerliOS to SourceForge
« Reply #1 on: June 06, 2014, 04:15:32 am »
Another issue, is that it appears the BerliOS dump was faulty: inside bs_patches_0.1.xml, all instances of the tags status_id and category_id are empty.

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Re: Migrating BerliOS to SourceForge
« Reply #2 on: June 06, 2014, 06:03:50 am »
Attached is a start at creating a conversion script (Python).  (The .patch must be applied first to remove invalid characters from the XML dump.)
Unfortunately SourceForge import does not tell you what the errors are when an import fails, so this will not be easy.

Offline oBFusCATed

  • Developer
  • Lives here!
  • *****
  • Posts: 13413
    • Travis build status
Re: Migrating BerliOS to SourceForge
« Reply #3 on: June 06, 2014, 08:53:55 am »
I don't think we should do any migration at all.
We cannot match the users on the two systems, but most bugs require a dialogue with the user in order to gather more information or to understand what the problem was. Thus will end with a pile of bugs no one would bother to try to fix.
(most of the time I ignore long posts)
[strangers don't send me private messages, I'll ignore them; post a topic in the forum, but first read the rules!]

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #4 on: June 06, 2014, 09:09:04 am »
@Alpha, maybe, we should ask the questions on SF, I and Morten have asked there, see:
Bug/feature reqeust move to Sourceforge

@OBF, If we don't migrate, we may lose a lot of resources(some patches, feature requests in BerliOS are very useful)
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline oBFusCATed

  • Developer
  • Lives here!
  • *****
  • Posts: 13413
    • Travis build status
Re: Migrating BerliOS to SourceForge
« Reply #5 on: June 06, 2014, 08:52:20 pm »
If something is useful it would be requested again.
The bug tracker on berlios is full of invalid or abandoned (by the reporter) issues.
(most of the time I ignore long posts)
[strangers don't send me private messages, I'll ignore them; post a topic in the forum, but first read the rules!]

Offline BlueHazzard

  • Developer
  • Lives here!
  • *****
  • Posts: 3353
Re: Migrating BerliOS to SourceForge
« Reply #6 on: June 06, 2014, 09:15:32 pm »
I'm with obfuscated, the patch and also the bugtracker on berlios where to old, and to bad maintained to get useful things from them. Also if some patch where useful they are now integrated or they where not necessary... I would count more on seeing it as a restart. The new bug tracker on sourceforge is again full with bugs/patches not maintained from the admins (no offense here!!!)...
They should get closed if there is nothing to say about them (like the first ticket)

greetings

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #7 on: June 08, 2014, 04:47:46 pm »
If something is useful it would be requested again.
The bug tracker on berlios is full of invalid or abandoned (by the reporter) issues.
Yes, there are many invalid issues. But I once added some issues as my TODO lists, and now they are all buried in the exported xml files  :-\ )
So it is great if the exported xml files can be imported to SF's ticket system.
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Re: Migrating BerliOS to SourceForge
« Reply #8 on: June 10, 2014, 05:25:35 am »
I have been thinking about this, and perhaps it is better if we create a read-only page for the history, and allow SF to start fresh.  Here is my beginning:
https://github.com/alpha0010/cb-history
http://alpha0010.github.io/cb-history/patches.html

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #9 on: June 10, 2014, 07:25:39 am »
I have been thinking about this, and perhaps it is better if we create a read-only page for the history, and allow SF to start fresh.  Here is my beginning:
https://github.com/alpha0010/cb-history
http://alpha0010.github.io/cb-history/patches.html
Nice work, the html page looks good.
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Re: Migrating BerliOS to SourceForge
« Reply #10 on: June 11, 2014, 04:25:45 am »
The bugs listing is populated.
http://alpha0010.github.io/cb-history/bugs.html

Next up, features list.  Then I will see what I can do about filtering and searching.

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #11 on: June 11, 2014, 09:12:17 am »
The bugs listing is populated.
http://alpha0010.github.io/cb-history/bugs.html

Next up, features list.  Then I will see what I can do about filtering and searching.
Great.
One suggestion:
Is it possible to translate the link in the comments of Patch to Bug items?
See: http://alpha0010.github.io/cb-history/patches/3502-Allow_C_11_com.html There is a link:
Code
https://developer.berlios.de/bugs/?func=detailbug&bug_id=19125&group_id=5358
in the comments.

Thanks.
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Re: Migrating BerliOS to SourceForge
« Reply #12 on: June 11, 2014, 11:39:17 pm »
Is it possible to translate the link in the comments of Patch to Bug items?
I think so.  I already have some local code starting that; but I think I should finish the features list first so I can cross link between the three.

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #13 on: June 12, 2014, 05:49:38 am »
Hi, alpha, I may be aggressive. Here is another idea: once a bug is fixed in our trunk, can the bug web page be marked as closed or fixed. I mean if it can have futures(API) that devs have rights to edit the issue item. Thanks.
« Last Edit: June 12, 2014, 05:57:06 am by ollydbg »
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #14 on: June 13, 2014, 05:01:42 am »
I have update our wiki home page, so that bugs/features direct to SF and the pages your created.
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Re: Migrating BerliOS to SourceForge
« Reply #15 on: June 15, 2014, 04:14:02 am »
All pages on http://alpha0010.github.io/cb-history/ are now populated (lots of issues scraping together the features page because the dump from BerliOS contains none of that data) with all history I was able to get access to.  Links within the comments that direct to BeriOS are (for the most part) rewritten to link internally.

Here is another idea: once a bug is fixed in our trunk, can the bug web page be marked as closed or fixed. I mean if it can have futures(API) that devs have rights to edit the issue item.
Hmm, this would be difficult to do live because hosting webpages on github restricts you to serving only static content.  I could grant devs commit access to the repo.  Or, I could regenerate the pages if someone lets me know whenever a ticket is closed.

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #16 on: June 18, 2014, 08:28:17 am »
Hi, Alpha, with you page and Google, I can quick find and locate an old bug(see: Re: Patch for inserting implementation), thanks.

Here is a small bug.
Look at the page: http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html, the first comments still contains a link which jump to berlios.

Here is another idea: once a bug is fixed in our trunk, can the bug web page be marked as closed or fixed. I mean if it can have futures(API) that devs have rights to edit the issue item.
Hmm, this would be difficult to do live because hosting webpages on github restricts you to serving only static content.  I could grant devs commit access to the repo.  Or, I could regenerate the pages if someone lets me know whenever a ticket is closed.
Fine, thanks.
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #17 on: June 18, 2014, 10:08:00 am »
Another two issue:
1, The web link format is currently
Code
http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
Is it possible to change to some thing like:
Code
http://alpha0010.github.io/cb-history/bugs/18526.html
which is much cleaner.

2, Is comments in the same thread sorted? In the page: http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
I see that a newer comment is put in the first.

Still these can be feature request, thanks. :)
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Re: Migrating BerliOS to SourceForge
« Reply #18 on: June 20, 2014, 12:31:18 am »
Look at the page: http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html, the first comments still contains a link which jump to berlios.
Odd... I must have messed up my regex's or something; looking into it.

1, The web link format is currently
Code
http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
Is it possible to change to some thing like:
Code
http://alpha0010.github.io/cb-history/bugs/18526.html
which is much cleaner.
I could change it, but I personally prefer having some detail in the file name.  That way, it is easier to identify files on disk (especially if you are downloading multiple patch files).  What do you think?  Maybe simplify the .html, but leave the .patch file names?

2, Is comments in the same thread sorted? In the page: http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
I see that a newer comment is put in the first.
They are supposed to be sorted.  Reviewing my code, it appears some them get sorted, and some of them just (incorrectly) assume they are already sorted.

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #19 on: June 20, 2014, 02:19:42 am »

1, The web link format is currently
Code
http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
Is it possible to change to some thing like:
Code
http://alpha0010.github.io/cb-history/bugs/18526.html
which is much cleaner.
I could change it, but I personally prefer having some detail in the file name.  That way, it is easier to identify files on disk (especially if you are downloading multiple patch files).  What do you think?  Maybe simplify the .html, but leave the .patch file names?
Hi, thanks.
The reason I would like to see a short html is that some times, I may add this link to our SVN commit message, such as:
Code
* CC: fix a bug xxxx, see: http://alpha0010.github.io/cb-history/bugs/18526.html
So, we can have a clean web page reference. I don't have much strong option whether option is good.  :)

About the patch names, I totally agree with you, the patch name should have some details in the file name.  :)
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Re: Migrating BerliOS to SourceForge
« Reply #20 on: June 22, 2014, 08:01:56 pm »
Pages renamed and comments sorted.

Offline ollydbg

  • Developer
  • Lives here!
  • *****
  • Posts: 5930
  • OpenCV and Robotics
    • Chinese OpenCV forum moderator
Re: Migrating BerliOS to SourceForge
« Reply #21 on: June 23, 2014, 03:54:49 am »
Pages renamed and comments sorted.
Great work, thanks!
If some piece of memory should be reused, turn them to variables (or const variables).
If some piece of operations should be reused, turn them to functions.
If they happened together, then turn them to classes.

Offline Alpha

  • Developer
  • Lives here!
  • *****
  • Posts: 1513
Re: Migrating BerliOS to SourceForge
« Reply #22 on: June 27, 2014, 04:27:38 am »
The pages all have basic filtering controls, so now it is a bit more manageable to navigate.  If anyone has a request for another field I implement filtering on, let me know (although, I would prefer to keep filters down to only the most useful ones).