php - Most efficient way to calculate 'popularity' of objects on website -

-

ok i'm building site people can post news, comments, questions, etc. people can rate of these objects, favorite of them, share them, etc. site php+mysql. wrote script in php following:

  1. grab comments , scores added them in past 5 minutes. add record 'popularity' table change in popularity each comment object.
  2. grab news , scores/views/favorites/shares added them. calculate popularity each news story (taking account change in popularity of comments attached them step 1) , insert record popularity table change in popularity each news object.
  3. repeat step 2 questions , other object types

i tried run script (it's symfony task) every 5 minutes cron job , php started choking , eating of server resources.

what preferred way run background analytics script calculates new data based on data in mysql db, inserts calculated data db? i'm sure i'm missing basic procedures here. should note db on different server , server had no resource problems. problem seems confined php choking on application server looping through objects, calculating popularity (simple calculations), , inserting db.

thanks

-- edit

how replicating db server used calculations. run popularity script on calculation server replicated db , insert calculated popularity records live db. of course delayed that's not huge deal. i'm not sure if fix php resource consumption issue though.

well first thing try reduce number of queries execute. important if sql , web servers on different machines. try use joins calculate popularity of news items without getting through comments individually.

well can calculate popularity of comments , popularity of new items in same query. (eg select sum(rating) news, comments, rating comments.news_id = news.id , rating.comment_id = comments.id (this query oversimplified still...)) cuz main problem amount of queries have execute , there enough resources on mysql server. because of time sql server wait next query arrive. communications across network gazillion times slower between cpu , ram. happens is: php sends query mysql server , waits response. mysql gets query processes, sends response , waits next query. waiting taking time... either reduce amount of queries or send quires in same time using mysqli http://php.net/manual/en/mysqli.multi-query.php


Comments

Post a Comment

Popular posts from this blog

linux - Mailx and Gmail nss config dir -

-
i trying send mail linux command line using mailx command. can send local domain no problem want set mail send gmail account receive mail sent gmail account. after configuring mail.rc so: account gmail { set smtp=smtps://smtp.gmail.com:587 set smtp-auth=login set smtp-auth-user=username@gmail.com set smtp-auth-password=password set ssl-verify=ignore } i error: resolving host smtp.gmail.com . . . done. connecting 74.125.25.109 . . . connected. missing "nss-config-dir" variable. "/home/username/dead.letter" 11/354 . . . message not sent. after looking "nss-config-dir" here , located certn.db , keyn.db files , added mail.rc so: account gmail { set smtp=smtps://smtp.gmail.com:587 set smtp-auth=login set smtp-auth-user=username@gmail.com set smtp-auth-password=password set ssl-verify=ignore set nss-config-dir=/home/user/.mozilla/firefox/location.default } now when try send mail using command: echo "sent gmail account" | mailx -v -a
Read more

c# - Is it possible to remove an existing registration from Autofac container builder? -

-
something along lines: builder.registertype<mytype>().as<itype>(); builder.registertype<mytype2>().as<itype>(); builder.deregistertype<mytype>().as<itype>() var container = builder.build(); var types = container.resolve<ienumerable<itype>>(); assert.istrue(types.count == 1); assert.istrue(types[0].gettype == typeof(mytype2)); scenario: go through bunch of assemblies , go register types want make sure have 1 implementation of given type. need before create container. track on own nice if autofac me bit. this cannot done directly using containerbuilder , unless start on new one. mind you, having first built container should able construct new container filtering away unwanted types , reusing registrations first container. this: ... var container = builder.build(); builder = new containerbuilder(); var components = container.componentregistry.registrations .where(cr => cr.activator.limittype != typ
Read more

php - Mysql PK and FK char(36) vs int(10) -

-
i have read mysql can handle indexes , searches better if tables keys integers rather char(36) uuid's. is worth converting int(10)? note: use 1 server , have have plans use multiple databases concurrently therefore removing 1 of big reasons using uuid. our tables innodb if makes difference. thanks in advance. usually rdbms can handle integer keys pk more efficient, other datatypes. reason how build index column, yes: long dont require string (or other typed) keys, should use integers. however: char(36) , int(10) far away being equal, because int(10) much smaller, char(36). dont know, if require many different keys, should keep in mind. update, complete last paragraph: int(10) 32-bit, char(36) 36 - ^byte^ (= 288-bit). not mean, int consumes less space, means, char(36) has 4 times more different keys.
Read more