Retrieve KEYWORDS from META tag in a HTML WebPage using JAVA -

-

i want retrieve content words html webpage , keywords contained in meta tag of same html webpage using java.
example, consider html source code:

<html> <head> <meta name = "keywords" content = "deception, intricacy, treachery"> </head> <body> short html document.  <br> has 2 'lines'. </body> </html>

the content words here are: my, very, short, html, document, it, has, just, lines

note: punctuation , number '2' ruled out.

the keywords here are: deception, intricacy, treachery

i have created class purpose called webdoc, far have been able get. 

import java.io.bufferedreader; import java.io.ioexception; import java.io.inputstreamreader; import java.net.url; import java.util.set; import java.util.treeset;  public class webdoc {      protected url _url;     protected set<string> _contentwords;     protected set<string> _keywords      public webdoc(url paramurl) {         _url = paramurl;     }      public set<string> getcontents() throws ioexception {         //url url = new url(url);         set<string> contentwords = new treeset<string>();         bufferedreader in = new bufferedreader(new inputstreamreader(_url.openstream()));         string inputline;          while ((inputline = in.readline()) != null) {             // process each line.             contentwords.add(removetag(inputline));             //system.out.println(removetag(inputline));         }         in.close();         system.out.println(contentwords);         _contentwords = contentwords;         return contentwords;     }          public string removetag(string html) {         html = html.replaceall("\\<.*?>","");         html = html.replaceall("&","");         return html;     }        public set<string> getkeywords() {         //no idea !         return null;     }      public url geturl() {         return _url;     }      @override     public string tostring() {         return null;     } }

so, after answer redsoxfan meta-keywords, need split content lines. can use similar method there:

instead of

contentwords.add(removetag(inputline));

use

contentwords.addall(arrays.aslist(removetag(inputline).split("[^\\p{l}]+")));
  • .split(...) splits line @ non-letters (i hope works, please try , report), giving array of substrings, each should contain of letters, , empty strings between.
  • arrays.aslist(...) wraps array in list.
  • addall(...) adds elements of array set, not duplicates).

at end should delete empty string "" contentwords-set.


Comments

Post a Comment

Popular posts from this blog

linux - Mailx and Gmail nss config dir -

-
i trying send mail linux command line using mailx command. can send local domain no problem want set mail send gmail account receive mail sent gmail account. after configuring mail.rc so: account gmail { set smtp=smtps://smtp.gmail.com:587 set smtp-auth=login set smtp-auth-user=username@gmail.com set smtp-auth-password=password set ssl-verify=ignore } i error: resolving host smtp.gmail.com . . . done. connecting 74.125.25.109 . . . connected. missing "nss-config-dir" variable. "/home/username/dead.letter" 11/354 . . . message not sent. after looking "nss-config-dir" here , located certn.db , keyn.db files , added mail.rc so: account gmail { set smtp=smtps://smtp.gmail.com:587 set smtp-auth=login set smtp-auth-user=username@gmail.com set smtp-auth-password=password set ssl-verify=ignore set nss-config-dir=/home/user/.mozilla/firefox/location.default } now when try send mail using command: echo "sent gmail account" | mailx -v -a
Read more

c# - Is it possible to remove an existing registration from Autofac container builder? -

-
something along lines: builder.registertype<mytype>().as<itype>(); builder.registertype<mytype2>().as<itype>(); builder.deregistertype<mytype>().as<itype>() var container = builder.build(); var types = container.resolve<ienumerable<itype>>(); assert.istrue(types.count == 1); assert.istrue(types[0].gettype == typeof(mytype2)); scenario: go through bunch of assemblies , go register types want make sure have 1 implementation of given type. need before create container. track on own nice if autofac me bit. this cannot done directly using containerbuilder , unless start on new one. mind you, having first built container should able construct new container filtering away unwanted types , reusing registrations first container. this: ... var container = builder.build(); builder = new containerbuilder(); var components = container.componentregistry.registrations .where(cr => cr.activator.limittype != typ
Read more

php - Mysql PK and FK char(36) vs int(10) -

-
i have read mysql can handle indexes , searches better if tables keys integers rather char(36) uuid's. is worth converting int(10)? note: use 1 server , have have plans use multiple databases concurrently therefore removing 1 of big reasons using uuid. our tables innodb if makes difference. thanks in advance. usually rdbms can handle integer keys pk more efficient, other datatypes. reason how build index column, yes: long dont require string (or other typed) keys, should use integers. however: char(36) , int(10) far away being equal, because int(10) much smaller, char(36). dont know, if require many different keys, should keep in mind. update, complete last paragraph: int(10) 32-bit, char(36) 36 - ^byte^ (= 288-bit). not mean, int consumes less space, means, char(36) has 4 times more different keys.
Read more