Omnimaga

Omnimaga => News => Topic started by: DJ Omnimaga on February 04, 2012, 01:23:58 am

Title: All posts from 2005 to 2008 back online!
Post by: DJ Omnimaga on February 04, 2012, 01:23:58 am
A large part of Omnimaga history that was gone for over 4 years now has come back to life. Yesterday, it has come to our attention that the previous Omnimaga forums that we used from 2005 to 2007, along with the temporary forums used in early 2008 before Omnimaga's 6 months dormancy, were back online. The discovery was made after Jonius7 was searching Google and stumbled upon one of the revived boards. They were only restored by Invisionfree recently, because I checked a month ago and they were still gone.

In other words it will only have taken 4 years before the Invisionfree team finally process the board restoration request. However, since the deletion of an Invisionfree board automatically backs up its entire content prior being processed, this means that every single post, member account (except prior April 9th 2006), avatar, file attachment and private message that were still available until the very end of each site remained intact. An extra sub-forum on the Invisionfree site was added to redirect to the temporary board, though, for ease of access, and both places are now in read-only mode (although it is still possible to login, for those who still remember their password).

So today, you can once again access the entire forum content of the previous website where Omnimaga was located from May 2005 to December 31st 2007 below:
http://z9.invisionfree.com/omnimaga/

And obviously, the Omnimaga temporary board used afterward until March 3rd 2008:
http://s1.zetaboards.com/omnimaga/index/

And here is a list of every forum attachments ever uploaded from May 2005 to March 2008. Note that all files that are not images were renamed by IPB software, so for example, THEGAME.8xp became p11563638.ibf. Simply change the name after downloading it from the list:
http://xlib.mtv-music-generator.com/oldomnifiles/

In 2008, the original plan was to merge the content of those boards with this one if they ever returned online, to keep all of Omnimaga history in one place. Members' post counts were going to be merged as well. However I am no longer admin and writing the script to perform the post merging task would be an incredible task, so in short terms, the content of those sites will remain as they currently are or possibly converted to standalone SMF format.

For those who are nostalgic, remember that you can still access the even older Omnimaga site (http://www.omnimaga.org/oldsite/index_v1.html) that used (poorly-coded) static pages too, along with its minor (http://www.omnimaga.org/oldsite/index_v2.html) theme redesigns (http://www.omnimaga.org/oldsite/index_v3.html).
Title: Re: All posts from 2005 to 2008 back online!
Post by: annoyingcalc on February 04, 2012, 02:32:05 am
:w00t:
Title: Re: All posts from 2005 to 2008 back online!
Post by: Netham45 on February 04, 2012, 06:30:49 am
Haha, they finally brought it back online? We applied for our sites to be restored from backup what, 4 years ago? (Maybe I should have read all the news article. `-`)
Title: Re: All posts from 2005 to 2008 back online!
Post by: Radical Pi on February 04, 2012, 07:31:08 am
Wow, I never expected this to happen. This is pretty cool
I guess today I'll be nostalgia-binging through the old archives :D
Title: Re: All posts from 2005 to 2008 back online!
Post by: TIfanx1999 on February 04, 2012, 07:59:14 am
I was quite shocked to find out that these *finally* got restored. O.O Pretty cool! :D
Title: Re: All posts from 2005 to 2008 back online!
Post by: yunhua98 on February 04, 2012, 12:03:22 pm
wow, this is great.  You you think the posts can be integrated into the new forum?
Title: Re: All posts from 2005 to 2008 back online!
Post by: Juju on February 04, 2012, 12:17:34 pm
Probably. If we figure out how. Although there's a link to those forums everywhere in this forum.

Anyway that's pretty nice. And that was damn long.
Title: Re: All posts from 2005 to 2008 back online!
Post by: DJ Omnimaga on February 04, 2012, 02:23:15 pm
The trick to include all posts would be to:

1) Manually update each remaining user post counts to merge their original account one with their current ones. Update their account with their old join date.

2) Purchase the databases from Invisionfree or use a screenscrapping script to extract the posts from the boards. Note: I was planning to pay since the beginning, assuming the restoration was not expensive (finally the latter was free). The former gives us an InvisionBoard 1.3.1 database and the latter gives us an SMF or PHPBB board (although if Jimbauwens uses his script, then we just get HTML static pages). NOTE: There are no conversion purchase for Zetaboards, so for that a screenscrapping script would be needed.

3) Convert the boards to SMF, then upgrade to SMF 1.1.16, if either are needed.

4) To save work, empty the PM, members and attachments tables if needed. Basically get rid of every account on the 3 databases.

5) Install every Omnimaga mods on the other SMF boards, so when importing the posts after doing number #5, no error about mismatching amount of columns or something occur (for example, the post rating system adds extra rows to the messages table).

6) Turn current board offline and do a backup

7) Run an MySQL query through database 1 (z7.invisionfree.com/Omnimaga) to increment post IDs by 300000, topic IDs by 30000 and so on. Do the same with database 2 (z9.invisionfree), but with 350000 and 35000 respectively. Same for database 3 (the Zetaboards), with 400000 and 40000 and finally the current database, with 500000 and 50000. This will ensure no post ID overlaps or something.

8) Now all links pointing to specific threads or posts on the current board are broken. What to do? Put in some server script, .htaccess or DNS setting (not sure what it would have to be) that will cause people to be redirected to higher post IDs whenever they click or type a link to an original post ID. So for example, http://ourl.ca/15110/282987 would automatically redirect to http://ourl.ca/65110/782987 . For the Invisionfree links, we don't really care since it's old.

9) Import the older data in the current board database.

10) The main issue here is to not forget to increment a single member ID. For example if you ever forget on one database to increment board categories, then they won't be imported or they will overwrite

11) Now you got a shitload of extra board sub-forums! Simply move their respective content (I could do that) to the current board ones (for example, News topic from the 2006-07 sub-forum to news) then get rid of duplicate categories. For the 2005-06 database, there is only one category, so just leave that category intact while I myself move the old topics back to their respective sections (as news editor I can help moving topics).

12) Edit the topic start dates of the old 2004-05 news articles to the original ones at http://www.omnimaga.org/oldsite/index_v3.html

12) Fix possible messed up post counts

In  other words, yes there is a bunch of work to do, especially considering our installed board mods installed extra SQL fields to our tables.
Title: Re: All posts from 2005 to 2008 back online!
Post by: yunhua98 on February 04, 2012, 04:41:10 pm
The discovery was made after Jonius7 was searching Google and stumbled upon one of the revived boards. They were only restored by Invisionfree recently, because I checked a month ago and they were still gone.
Just want to point out a mistake.  HOMER-16 found it, not Jonius.  ;)
http://ourl.ca/15092/282643
Title: Re: All posts from 2005 to 2008 back online!
Post by: apcalc on February 04, 2012, 06:09:37 pm
Great news!  Nice to see this info back! :)
Title: Re: All posts from 2005 to 2008 back online!
Post by: Scipi on February 04, 2012, 06:10:27 pm
The discovery was made after Jonius7 was searching Google and stumbled upon one of the revived boards. They were only restored by Invisionfree recently, because I checked a month ago and they were still gone.
Just want to point out a mistake.  HOMER-16 found it, not Jonius.  ;)
http://ourl.ca/15092/282643

Technically, DJ_O actually found it from my search results of his hotmail email account. :P
Title: Re: All posts from 2005 to 2008 back online!
Post by: DJ Omnimaga on February 04, 2012, 11:08:48 pm
Oh wait right, HOMER-16, not Jonius.

Also from the 2008 site I still have the spam from the anon raid and I wouldn't be surprised if everyone else still had theirs archived too. I still also got 5 of the anon posts located in the spam section (there were over 50, but I deleted most back then)

(http://djomni.57o9.org/random/feb2008anonraid.png)

(Also that board system was so hard to edit, CSS-wise. X.x)

EDIT the remaining spam topics http://s1.zetaboards.com/omnimaga/forum/64561/
Title: Re: All posts from 2005 to 2008 back online!
Post by: Deep Toaster on February 04, 2012, 11:54:59 pm
If all that could be added into the current Omnimaga site, that would add three years in posts :o
Title: Re: All posts from 2005 to 2008 back online!
Post by: DJ Omnimaga on February 05, 2012, 12:26:23 am
Indeed and it would be easier to access. Also it would be nice to be able to search through those posts, since the Invisionfree search engine has been disabled since 2002.
Title: Re: All posts from 2005 to 2008 back online!
Post by: Deep Toaster on February 05, 2012, 12:30:51 am
lol I wonder how many posts you'd have with those.

EDIT: 43,706 ... enough for over 9000x4 (http://omniurl.tk/828/38986/) O.O
Title: Re: All posts from 2005 to 2008 back online!
Post by: DJ Omnimaga on February 05, 2012, 12:32:35 am
True, although still far behind Kerm :P
Title: Re: All posts from 2005 to 2008 back online!
Post by: DJ Omnimaga on February 06, 2012, 09:03:46 pm
With the old boards back up, this means I could finally grab their daily post stats too! Note, however, that Invisionfree's stats are GMT-17 or something, though, for odd reasons, so a bunch of stats are a bit off. Also the stats for the temporary boards excludes deleted posts, otherwise February 11th and 12th 2008 would have close to 80 posts each (from the attack).
Title: Re: All posts from 2005 to 2008 back online!
Post by: Jonius7 on February 08, 2012, 04:47:41 am
Ah I was a bit surprised to see my name in a news article and from the topic about your gmail email. Actually I did find the invisionfree forums while searching on google for posts about Omnidance, in which links to omnidance 1/2 were on netham45.dyndns.org. http://s9.invisionfree.com/omnimaga/ar/t1698.htm

However I didn't think to bring it up at the time because I thought that they were always there, however I should have in the DJ_O Music song information/discography project: http://ourl.ca/13482

But uh yeah I guess I was lucky to be the first one to reply I guess...
Title: Re: All posts from 2005 to 2008 back online!
Post by: DJ Omnimaga on March 03, 2014, 02:48:28 am
Update: Old attachments from May 2005 to March 2008 are now listed at http://xlib.mtv-music-generator.com/oldomnifiles/

August 2008 to present attachments are supposed to be available at their usual locations (individual posts), unless SMF 2.0 software tampered with the links for any reasons.
Title: Re: All posts from 2005 to 2008 back online!
Post by: bb010g on March 11, 2014, 09:35:15 am
The even older Omnimaga site (http://www.omnimaga.org/oldsite/index_v1.html) seems to be down now.
Title: Re: All posts from 2005 to 2008 back online!
Post by: Eeems on March 11, 2014, 09:58:11 am
The even older Omnimaga site (http://www.omnimaga.org/oldsite/index_v1.html) seems to be down now.
Temporarily until I figure out a better spot to put it.
Title: Re: All posts from 2005 to 2008 back online!
Post by: DJ Omnimaga on March 11, 2014, 12:03:22 pm
On a good note, omnimaga.org/images/screenshots is still up :D


However, if you try to access the folder listing it now redirects to http://www.omnimaga.org/other-calc-related-projects-and-ideas/screenshots/ , so it's no longer possible again to browse through the old screenshots uploaded from 2004 to 2010.
Title: Re: All posts from 2005 to 2008 back online!
Post by: Eeems on March 11, 2014, 05:05:47 pm
I'll have to figure out a way to handle that. Currently all omnimaga.org/<name>/<name> urls are redirected to the best match for a board/topic it can find. I'll  add in something that ignores directories that exist.
Title: Re: All posts from 2005 to 2008 back online!
Post by: DJ Omnimaga on March 11, 2014, 05:09:57 pm
Ah I see now. That reminds me of something different that 1and1 did but it was kinda the same way in terms of auto-fixing broken links or something: Basically URLs were not case-sensitive and sometimes it would redirect when typing an URL with a typo in it. That is why there were many broken links after moving away from 1and1 x.x (eg Starcraft.swf)