Author Topic: General Decrease in Omnimaga Activity from 2011 levels - What can we do?  (Read 99961 times)

0 Members and 1 Guest are viewing this topic.

Offline TIfanx1999

  • ಠ_ಠ ( ͡° ͜ʖ ͡°)
  • CoT Emeritus
  • LV13 Extreme Addict (Next: 9001)
  • *
  • Posts: 6173
  • Rating: +191/-9
    • View Profile
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #195 on: October 21, 2012, 06:34:40 pm »
It seems crazy to me that Omnom takes up so many resources. Many websites I've been to have shoutboxes and don't seem to have any issues running them. Perhaps if Omnom(is rewritten) or a successor is written a more simplistic approach would be best.
« Last Edit: October 21, 2012, 06:35:06 pm by Art_of_camelot »

Offline Eeems

  • Mr. Dictator
  • Administrator
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6267
  • Rating: +318/-36
  • little oof
    • View Profile
    • Eeems
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #196 on: October 21, 2012, 07:23:25 pm »
It seems crazy to me that Omnom takes up so many resources. Many websites I've been to have shoutboxes and don't seem to have any issues running them. Perhaps if Omnom(is rewritten) or a successor is written a more simplistic approach would be best.
I've been thinking about adapting my node.js chat server for a while now. I've already got an irc bot that supports multiple servers and channels. The chat server itself has built in support for channels that I haven't implemented. I know that the chat server itself doesn't take up much ram and there is a lot of optimizing that the irc bot code could have. The irc bot also would take a lot less memory if it was only on one server instead of 2 or more. Each new server it is connected to adds a forked process.
/e

Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #197 on: October 21, 2012, 11:26:23 pm »
OmnomIRC was coded in a way that it arrives on Omnimaga as soon as possible back in 2010, with only like one hour of free time every week. Once Netham45 had vacations, he completely recoded it, but it did not let enough time to make it 100% perfect. It has more features than SAX but it never got the chance to even get close to being as optimized as it, since SAX has been maintained for over 7 years.

Omnom is way more optimized than it used to be, though, and NEtham45 had done a good job so far. Hopefully it can be improved even more or something based on it can be done (especially now that the source code is public).

Offline alberthrocks

  • Moderator
  • LV8 Addict (Next: 1000)
  • ********
  • Posts: 876
  • Rating: +103/-10
    • View Profile
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #198 on: October 21, 2012, 11:52:32 pm »
I haven't fixed the issue with my bot, but I've done two things to mitigate this issue:
1) I wrote a little daemon called CPUHero that kills any processes that eat up lots of CPU. When the bot dies, it (usually) gobbles CPU because it's stuck in a loop. (I'd appreciate any help with that!) Therefore, it should automatically get killed.
2) Sometimes, it doesn't trigger CPU usage. I wrote a quick web interface (inside CPUHero's interface) so that you can restart the bot! :) For security reasons, 3 people must click the button within 5 minutes to trigger a restart. (Don't abuse it!) Go here for the button: http://withg.org/albert/cpuhero/

Note that this ONLY applies to my alternate New bot. I have zero control over Netham45's "New" IRC bot.

For convenience, I've also placed the link in my sig for easier clicking. :)

Again, it's:
http://withg.org/albert/cpuhero/
« Last Edit: October 21, 2012, 11:52:54 pm by alberthrocks »
Withgusto Networks Founder and Administrator
Main Server Status: http://withg.org/status/
Backup Server Status: Not available
Backup 2/MC Server Status: http://mc.withg.org/status/


Proud member of ClrHome!

Miss my old signature? Here it is!
Spoiler For Signature:
Alternate "New" IRC post notification bot (Newy) down? Go here to reset it! http://withg.org/albert/cpuhero/

Withgusto Networks Founder and Administrator
Main Server Status: http://withg.org/status/
Backup Server Status: Not available
Backup 2/MC Server Status: http://mc.withg.org/status/

Activity remains limited due to busyness from school et al. Sorry! :( Feel free to PM, email, or if you know me well enough, FB me if you have a question/concern. :)

Don't expect me to be online 24/7 until summer. Contact me via FB if you feel it's urgent.


Proud member of ClrHome!

Spoiler For "My Projects! :D":
Projects:

Computer/Web/IRC Projects:
C______c: 0% done (Doing planning and trying to not forget it :P)
A_____m: 40% done (Need to develop a sophisticated process queue, and a pretty web GUI)
AtomBot v3.0: 0% done (Planning stage, may do a litmus test of developer wants in the future)
IdeaFrenzy: 0% done (Planning and trying to not forget it :P)
wxWabbitemu: 40% done (NEED MOAR FEATURES :P)

Calculator Projects:
M__ C_____ (an A____ _____ clone): 0% done (Need to figure out physics and Axe)
C2I: 0% done (planning, checking the demand for it, and dreaming :P)

Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #199 on: October 22, 2012, 03:53:17 pm »
Since OmnomIRC has troubles with auto-restarting/connect, wouldn't it be a bad idea to kill it when it takes too much resources?

Offline alberthrocks

  • Moderator
  • LV8 Addict (Next: 1000)
  • ********
  • Posts: 876
  • Rating: +103/-10
    • View Profile
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #200 on: October 22, 2012, 04:00:25 pm »
Since OmnomIRC has troubles with auto-restarting/connect, wouldn't it be a bad idea to kill it when it takes too much resources?
I will not deploy CPUHero on the server that runs OmnomIRC until I implement non-killing for limiting CPU usage.
Withgusto Networks Founder and Administrator
Main Server Status: http://withg.org/status/
Backup Server Status: Not available
Backup 2/MC Server Status: http://mc.withg.org/status/


Proud member of ClrHome!

Miss my old signature? Here it is!
Spoiler For Signature:
Alternate "New" IRC post notification bot (Newy) down? Go here to reset it! http://withg.org/albert/cpuhero/

Withgusto Networks Founder and Administrator
Main Server Status: http://withg.org/status/
Backup Server Status: Not available
Backup 2/MC Server Status: http://mc.withg.org/status/

Activity remains limited due to busyness from school et al. Sorry! :( Feel free to PM, email, or if you know me well enough, FB me if you have a question/concern. :)

Don't expect me to be online 24/7 until summer. Contact me via FB if you feel it's urgent.


Proud member of ClrHome!

Spoiler For "My Projects! :D":
Projects:

Computer/Web/IRC Projects:
C______c: 0% done (Doing planning and trying to not forget it :P)
A_____m: 40% done (Need to develop a sophisticated process queue, and a pretty web GUI)
AtomBot v3.0: 0% done (Planning stage, may do a litmus test of developer wants in the future)
IdeaFrenzy: 0% done (Planning and trying to not forget it :P)
wxWabbitemu: 40% done (NEED MOAR FEATURES :P)

Calculator Projects:
M__ C_____ (an A____ _____ clone): 0% done (Need to figure out physics and Axe)
C2I: 0% done (planning, checking the demand for it, and dreaming :P)

Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #201 on: October 22, 2012, 04:02:54 pm »
Ok good to hear. Limiting CPU usage (and RAM) would be a better idea I think.
« Last Edit: October 22, 2012, 04:03:26 pm by DJ_O »

Offline Yeong

  • Not a bridge
  • LV12 Extreme Poster (Next: 5000)
  • ************
  • Posts: 3739
  • Rating: +278/-12
  • Survivor of Apocalypse
    • View Profile
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #202 on: October 22, 2012, 04:22:12 pm »
omnom is back :D
Sig wipe!

Offline alberthrocks

  • Moderator
  • LV8 Addict (Next: 1000)
  • ********
  • Posts: 876
  • Rating: +103/-10
    • View Profile
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #203 on: October 22, 2012, 04:44:24 pm »
Ok good to hear. Limiting CPU usage (and RAM) would be a better idea I think.
I'm now enforcing CPU usage with CPULimit, which is a pretty safe tool. :)

To be honest, I don't think CPUHero is *that* bad. It gives the process a chance for "redemption" (less than 80% CPU usage). See below:
Code: [Select]
[Mon Oct 22 15:26:57 EDT 2012] [CPUHero] [Redemption] Society is rather peaceful... there are no trouble PIDs to redeem!
[Mon Oct 22 16:18:07 EDT 2012] [CPUHero] 6258 (php5-fpm) gets a PID_TROUBLE score! Process 6258's CPU usage was over 80! (CPU usage: 88)
[Mon Oct 22 16:18:07 EDT 2012] [CPUHero] Commandline for 6258:
[Mon Oct 22 16:18:07 EDT 2012] [CPUHero] User: www-data
[Mon Oct 22 16:18:08 EDT 2012] [CPUHero] 6258 (php5-fpm) now has a PID_TROUBLE score of 1, out of 3.
[Mon Oct 22 16:18:13 EDT 2012] [CPUHero] [Redemption] 6258 is on its way to redemption!
[Mon Oct 22 16:18:13 EDT 2012] [CPUHero] [Redemption] 6258 now has a PID_REDEMPTION score of 1, out of 3.
[Mon Oct 22 16:18:19 EDT 2012] [CPUHero] [Redemption] 6258 now has a PID_REDEMPTION score of 2, out of 3.
[Mon Oct 22 16:18:24 EDT 2012] [CPUHero] [Redemption] 6258 now has a PID_REDEMPTION score of 3, out of 3.
[Mon Oct 22 16:18:30 EDT 2012] [CPUHero] [Redemption] 6258 now has a PID_REDEMPTION score of 4, out of 3.
[Mon Oct 22 16:18:36 EDT 2012] [CPUHero] [Redemption] Probation is over! 6258 now has a PID_REDEMPTION score of 4/3 - it's now free!
[Mon Oct 22 16:18:41 EDT 2012] [CPUHero] [Redemption] Society is rather peaceful... there are no trouble PIDs to redeem!
(Yes, I was bored when writing this - you have to make the output somewhat interesting, right? :P)

Therefore, if there's any CPU usage spikes, no killing will occur.
(Then again, if OmnomIRC gets used constantly, then that's another story...)

You can watch it live here: http://withg.org/albert/cpuhero/
Withgusto Networks Founder and Administrator
Main Server Status: http://withg.org/status/
Backup Server Status: Not available
Backup 2/MC Server Status: http://mc.withg.org/status/


Proud member of ClrHome!

Miss my old signature? Here it is!
Spoiler For Signature:
Alternate "New" IRC post notification bot (Newy) down? Go here to reset it! http://withg.org/albert/cpuhero/

Withgusto Networks Founder and Administrator
Main Server Status: http://withg.org/status/
Backup Server Status: Not available
Backup 2/MC Server Status: http://mc.withg.org/status/

Activity remains limited due to busyness from school et al. Sorry! :( Feel free to PM, email, or if you know me well enough, FB me if you have a question/concern. :)

Don't expect me to be online 24/7 until summer. Contact me via FB if you feel it's urgent.


Proud member of ClrHome!

Spoiler For "My Projects! :D":
Projects:

Computer/Web/IRC Projects:
C______c: 0% done (Doing planning and trying to not forget it :P)
A_____m: 40% done (Need to develop a sophisticated process queue, and a pretty web GUI)
AtomBot v3.0: 0% done (Planning stage, may do a litmus test of developer wants in the future)
IdeaFrenzy: 0% done (Planning and trying to not forget it :P)
wxWabbitemu: 40% done (NEED MOAR FEATURES :P)

Calculator Projects:
M__ C_____ (an A____ _____ clone): 0% done (Need to figure out physics and Axe)
C2I: 0% done (planning, checking the demand for it, and dreaming :P)

Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #204 on: November 30, 2012, 07:41:23 pm »
Well it looks like that for Late October and most of November, the rising popularity of Nspire Linux and especially the TI-84 Plus C Silver Edition announcement has helped boosting activity a lot. Earlier this Fall, some people were mentioning that most people had less school work starting in November and that this would help, but sometimes Thanksgiving drives a bunch of people away or they go less active for some reasons anyway, yet this month there are 1400 more posts than October.

Hoping that the 84PCSE brings interesting opportunities for BASIC, ASM and hopefully Axe programmers when it comes out (unlike the Nspire). Just remember the 84+/89T craze back in 2004, and that wasn't even a color/resolution upgrade (although back then cellphones and handhelds were not as fierce competition towards calcs as they are today).
« Last Edit: November 30, 2012, 07:41:39 pm by DJ_O »

Offline epic7

  • Chopin!
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2200
  • Rating: +135/-8
  • I like robots
    • View Profile
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #205 on: November 30, 2012, 07:45:41 pm »
Yup. :D
Now that I'm getting back into calculator stuff, my post rate has increased a ton this month, as well
« Last Edit: November 30, 2012, 07:47:06 pm by epic7 »

Offline Rhombicuboctahedron

  • LV6 Super Member (Next: 500)
  • ******
  • Posts: 437
  • Rating: +41/-6
    • View Profile
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #206 on: November 30, 2012, 10:05:48 pm »
Earlier this Fall, some people were mentioning that most people had less school work starting in November
I have three German essays, 5 nights of calculus homework, some Physics homework, a big Government project, and two in-class essays next week

Offline Sorunome

  • Fox Fox Fox Fox Fox Fox Fox!
  • Support Staff
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 7920
  • Rating: +374/-13
  • Derpy Hooves
    • View Profile
    • My website! (You might lose the game)
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #207 on: November 30, 2012, 10:19:10 pm »
Currently we are on an upwards activitity trail :D

THE GAME
Also, check out my website
If OmnomIRC is screwed up, blame me!
Click here to give me an internet!

Offline Rhombicuboctahedron

  • LV6 Super Member (Next: 500)
  • ******
  • Posts: 437
  • Rating: +41/-6
    • View Profile
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #208 on: December 02, 2012, 12:47:34 am »
I noticed that most online ever happened yesterday.

Offline Sorunome

  • Fox Fox Fox Fox Fox Fox Fox!
  • Support Staff
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 7920
  • Rating: +374/-13
  • Derpy Hooves
    • View Profile
    • My website! (You might lose the game)
Re: General Decrease in Omnimaga Activity - What can we do?
« Reply #209 on: December 02, 2012, 12:48:37 am »
wow, just wow, here were tons of guests yesterday, like thousands

THE GAME
Also, check out my website
If OmnomIRC is screwed up, blame me!
Click here to give me an internet!