Code::Blocks Forums

Developer forums (C::B DEVELOPMENT STRICTLY!) => Development => Topic started by: Alpha on June 06, 2014, 04:03:24 am

Title: Migrating BerliOS to SourceForge
Post by: Alpha on June 06, 2014, 04:03:24 am
I have been starting a few tests with with migration of the BerliOS dump files, and have run into what will likely be a major issue.  Attached files on SourceForge do not appear anywhere in the complete export.  They are only referenced by a url, but give no hint of how a file could be imported to that location.
Code
{
  "status": "open",
  "reported_by_id": "5124334124b0d9277e70766c",
  "related_artifacts": [],
  "attachments": [
    {
      "url": "http://sourceforge.net/p/ticketexport/patches/3/attachment/converterTest.py",
      "bytes": 921
    }
  ],
  "reported_by": "alpha0010",
  "description": "Extended description.",
  "labels": [],
  "assigned_to": "alpha0010",
  "assigned_to_id": "5124334124b0d9277e70766c",
  "private": false,
  "summary": "Ticket with patch",
  "discussion_thread": {
    "_id": "bc4d1a58",
    "posts": [],
    "discussion_id": "529d6ac0d46bb4611598533a",
    "subject": ""
  },
  "mod_date": "2014-06-06 01:34:22.120000",
  "votes_down": 0,
  "votes_up": 0,
  "_id": "53911a9df1fd8d55b0aeeeb3",
  "discussion_thread_url": "http://sourceforge.net/rest/p/ticketexport/patches/_discuss/thread/bc4d1a58/",
  "ticket_num": 3,
  "custom_fields": {
    "_milestone": "1.0"
  },
  "created_date": "2014-06-06 01:34:21.961000"
}
Title: Re: Migrating BerliOS to SourceForge
Post by: Alpha on June 06, 2014, 04:15:32 am
Another issue, is that it appears the BerliOS dump was faulty: inside bs_patches_0.1.xml, all instances of the tags status_id and category_id are empty.
Title: Re: Migrating BerliOS to SourceForge
Post by: Alpha on June 06, 2014, 06:03:50 am
Attached is a start at creating a conversion script (Python).  (The .patch must be applied first to remove invalid characters from the XML dump.)
Unfortunately SourceForge import does not tell you what the errors are when an import fails, so this will not be easy.
Title: Re: Migrating BerliOS to SourceForge
Post by: oBFusCATed on June 06, 2014, 08:53:55 am
I don't think we should do any migration at all.
We cannot match the users on the two systems, but most bugs require a dialogue with the user in order to gather more information or to understand what the problem was. Thus will end with a pile of bugs no one would bother to try to fix.
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 06, 2014, 09:09:04 am
@Alpha, maybe, we should ask the questions on SF, I and Morten have asked there, see:
Bug/feature reqeust move to Sourceforge (http://forums.codeblocks.org/index.php/topic,18540.msg126882.html#msg126882)

@OBF, If we don't migrate, we may lose a lot of resources(some patches, feature requests in BerliOS are very useful)
Title: Re: Migrating BerliOS to SourceForge
Post by: oBFusCATed on June 06, 2014, 08:52:20 pm
If something is useful it would be requested again.
The bug tracker on berlios is full of invalid or abandoned (by the reporter) issues.
Title: Re: Migrating BerliOS to SourceForge
Post by: BlueHazzard on June 06, 2014, 09:15:32 pm
I'm with obfuscated, the patch and also the bugtracker on berlios where to old, and to bad maintained to get useful things from them. Also if some patch where useful they are now integrated or they where not necessary... I would count more on seeing it as a restart. The new bug tracker on sourceforge is again full with bugs/patches not maintained from the admins (no offense here!!!)...
They should get closed if there is nothing to say about them (like the first ticket)

greetings
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 08, 2014, 04:47:46 pm
Quote from: oBFusCATed on June 06, 2014, 08:52:20 pm
If something is useful it would be requested again.
The bug tracker on berlios is full of invalid or abandoned (by the reporter) issues.
Yes, there are many invalid issues. But I once added some issues as my TODO lists, and now they are all buried in the exported xml files  :-\ )
So it is great if the exported xml files can be imported to SF's ticket system.
Title: Re: Migrating BerliOS to SourceForge
Post by: Alpha on June 10, 2014, 05:25:35 am
I have been thinking about this, and perhaps it is better if we create a read-only page for the history, and allow SF to start fresh.  Here is my beginning:
https://github.com/alpha0010/cb-history (https://github.com/alpha0010/cb-history)
http://alpha0010.github.io/cb-history/patches.html (http://alpha0010.github.io/cb-history/patches.html)
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 10, 2014, 07:25:39 am
Quote from: Alpha on June 10, 2014, 05:25:35 am
I have been thinking about this, and perhaps it is better if we create a read-only page for the history, and allow SF to start fresh.  Here is my beginning:
https://github.com/alpha0010/cb-history (https://github.com/alpha0010/cb-history)
http://alpha0010.github.io/cb-history/patches.html (http://alpha0010.github.io/cb-history/patches.html)
Nice work, the html page looks good.
Title: Re: Migrating BerliOS to SourceForge
Post by: Alpha on June 11, 2014, 04:25:45 am
The bugs listing is populated.
http://alpha0010.github.io/cb-history/bugs.html (http://alpha0010.github.io/cb-history/bugs.html)

Next up, features list.  Then I will see what I can do about filtering and searching.
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 11, 2014, 09:12:17 am
Quote from: Alpha on June 11, 2014, 04:25:45 am
The bugs listing is populated.
http://alpha0010.github.io/cb-history/bugs.html (http://alpha0010.github.io/cb-history/bugs.html)

Next up, features list.  Then I will see what I can do about filtering and searching.
Great.
One suggestion:
Is it possible to translate the link in the comments of Patch to Bug items?
See: http://alpha0010.github.io/cb-history/patches/3502-Allow_C_11_com.html There is a link:
Code
https://developer.berlios.de/bugs/?func=detailbug&bug_id=19125&group_id=5358
in the comments.

Thanks.
Title: Re: Migrating BerliOS to SourceForge
Post by: Alpha on June 11, 2014, 11:39:17 pm
Quote from: ollydbg on June 11, 2014, 09:12:17 am
Is it possible to translate the link in the comments of Patch to Bug items?
I think so.  I already have some local code starting that; but I think I should finish the features list first so I can cross link between the three.
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 12, 2014, 05:49:38 am
Hi, alpha, I may be aggressive. Here is another idea: once a bug is fixed in our trunk, can the bug web page be marked as closed or fixed. I mean if it can have futures(API) that devs have rights to edit the issue item. Thanks.
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 13, 2014, 05:01:42 am
I have update our wiki home page, so that bugs/features direct to SF and the pages your created.
Title: Re: Migrating BerliOS to SourceForge
Post by: Alpha on June 15, 2014, 04:14:02 am
All pages on http://alpha0010.github.io/cb-history/ (http://alpha0010.github.io/cb-history/) are now populated (lots of issues scraping together the features page because the dump from BerliOS contains none of that data) with all history I was able to get access to.  Links within the comments that direct to BeriOS are (for the most part) rewritten to link internally.

Quote from: ollydbg on June 12, 2014, 05:49:38 am
Here is another idea: once a bug is fixed in our trunk, can the bug web page be marked as closed or fixed. I mean if it can have futures(API) that devs have rights to edit the issue item.
Hmm, this would be difficult to do live because hosting webpages on github restricts you to serving only static content.  I could grant devs commit access to the repo.  Or, I could regenerate the pages if someone lets me know whenever a ticket is closed.
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 18, 2014, 08:28:17 am
Hi, Alpha, with you page and Google, I can quick find and locate an old bug(see: Re: Patch for inserting implementation (http://forums.codeblocks.org/index.php/topic,19370.msg132400.html#msg132400)), thanks.

Here is a small bug.
Look at the page: http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html, the first comments still contains a link which jump to berlios.

Quote from: Alpha on June 15, 2014, 04:14:02 am
Quote from: ollydbg on June 12, 2014, 05:49:38 am
Here is another idea: once a bug is fixed in our trunk, can the bug web page be marked as closed or fixed. I mean if it can have futures(API) that devs have rights to edit the issue item.
Hmm, this would be difficult to do live because hosting webpages on github restricts you to serving only static content.  I could grant devs commit access to the repo.  Or, I could regenerate the pages if someone lets me know whenever a ticket is closed.
Fine, thanks.
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 18, 2014, 10:08:00 am
Another two issue:
1, The web link format is currently
Code
http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
Is it possible to change to some thing like:
Code
http://alpha0010.github.io/cb-history/bugs/18526.html
which is much cleaner.

2, Is comments in the same thread sorted? In the page: http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
I see that a newer comment is put in the first.

Still these can be feature request, thanks. :)
Title: Re: Migrating BerliOS to SourceForge
Post by: Alpha on June 20, 2014, 12:31:18 am
Quote from: ollydbg on June 18, 2014, 08:28:17 am
Look at the page: http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html, the first comments still contains a link which jump to berlios.
Odd... I must have messed up my regex's or something; looking into it.

Quote from: ollydbg on June 18, 2014, 10:08:00 am
1, The web link format is currently
Code
http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
Is it possible to change to some thing like:
Code
http://alpha0010.github.io/cb-history/bugs/18526.html
which is much cleaner.
I could change it, but I personally prefer having some detail in the file name.  That way, it is easier to identify files on disk (especially if you are downloading multiple patch files).  What do you think?  Maybe simplify the .html, but leave the .patch file names?

Quote from: ollydbg on June 18, 2014, 10:08:00 am
2, Is comments in the same thread sorted? In the page: http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
I see that a newer comment is put in the first.
They are supposed to be sorted.  Reviewing my code, it appears some them get sorted, and some of them just (incorrectly) assume they are already sorted.
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 20, 2014, 02:19:42 am
Quote from: Alpha on June 20, 2014, 12:31:18 am

Quote from: ollydbg on June 18, 2014, 10:08:00 am
1, The web link format is currently
Code
http://alpha0010.github.io/cb-history/bugs/18526-Insert_all_cl.html
Is it possible to change to some thing like:
Code
http://alpha0010.github.io/cb-history/bugs/18526.html
which is much cleaner.
I could change it, but I personally prefer having some detail in the file name.  That way, it is easier to identify files on disk (especially if you are downloading multiple patch files).  What do you think?  Maybe simplify the .html, but leave the .patch file names?
Hi, thanks.
The reason I would like to see a short html is that some times, I may add this link to our SVN commit message, such as:
Code
* CC: fix a bug xxxx, see: http://alpha0010.github.io/cb-history/bugs/18526.html
So, we can have a clean web page reference. I don't have much strong option whether option is good.  :)

About the patch names, I totally agree with you, the patch name should have some details in the file name.  :)
Title: Re: Migrating BerliOS to SourceForge
Post by: Alpha on June 22, 2014, 08:01:56 pm
Pages renamed and comments sorted.
Title: Re: Migrating BerliOS to SourceForge
Post by: ollydbg on June 23, 2014, 03:54:49 am
Quote from: Alpha on June 22, 2014, 08:01:56 pm
Pages renamed and comments sorted.
Great work, thanks!
Title: Re: Migrating BerliOS to SourceForge
Post by: Alpha on June 27, 2014, 04:27:38 am
The pages all have basic filtering controls, so now it is a bit more manageable to navigate.  If anyone has a request for another field I implement filtering on, let me know (although, I would prefer to keep filters down to only the most useful ones).