Apache Lucene Ultra Search Utility

By -
 Apache lucene sets the standard for Search and Indexing performance

It is high performance and full-feature text search engine fully written using java. It is used to any application that requires full-text search, especially cross platform.

It is open source project we can download it freely. Using this link to download the apache lucene from server download .

Features:

1. Scalable and High performance  Indexing
  • Small Ram  require i.e 1 MB Heap
  • Incremental indexing is faster than Batch indexing 
2. Powerful, Accurate and Efficient Searching algorithm
  •  It is support Ranked Searching i.e best result return first
  •  It is allow Fielded searching
  •  It is allow Sorting by any order
  •  It support Multiple-index searching 
  •  Allow concurrency access i.e at the same time indexing and updating it
  •  It is easy to fetching, join, and grouping data
  •  It is fast retrieve 

3. Stop-word processing
        
      Common words, Such as "a", "and" and "the" add little value to a search index. But since these words are so common, cataloging them will contribute considerably to the indexing time and index size. Most search engines not indexing certain words, called as stop words. 
       Lucene  handles stop words with the more general ANALYZER mechanism. the StopAnalyzer call which eliminates stop words from the input stream.

4. Stemming
       
        User desires a query for one word to match other similar words. For example , a query for "jump" should probably also match the words "jumped", "jumper" or  "jumps". Reducing a word to its root form is called STEMMING.
        Lucene does not yet implemented stemming. But it can be achived by using ANALYZER class.

5. Non-English Support

        Most search engines implicitly support english words. Use that words as query words. But lucene preprocess the input stream via ANALYZER class. It is provide the language specific filtering.

6. Cross-Platform Solution
  • It is purely Java
  • It is available in open source apache         
For more details visit Apache Lucene5.1

Comments

Post a Comment

Popular posts from this blog

Pyhton auto post to blogger using Google blogger API

By -
Image
    Here we are going to see the end to end flow of auto post into blogger using python and google blogger API.     For example , if you want to show the currency value against the $ in your blog, It is hard to update an hour/day wise by manual. To solve this we can generate the python script to update the blog information through the google blogger API. We have the many use case using python automation concept. In fact, We can automate the blog writing through the below script combined with the content/webs-crawler . The web crawler link is attached here. It will useful for us to reduce the time consumption and work load.  Over view: Python code automatically post to blogger and publish the post with out human intervention. Approaches: Google oauth2 authentication Google blogger V3 API  (python client library) Python program to automate Prerequisite: Python 2.7, or 3.4 or higher Blogger account - Create the blogger account if not through this link Need to inst
Read more

Connect VPN via Python

By -
Here we are going to connect the VPN services through the python. After connect the VPN we can crawl the blocked website and so on. The script going to use the free VPN services provided by VPNGate . The VPN based on the user input countries. Prerequired Open vpn must be available in your system. Use the below command to install open vpn in your linux machine, 1 apt-get install openvpn easy-rsa further more details for the installation , Please follow the link install openvpn Usage Run the script by providing the desired output country like given below, 1 python script.py IN Instead of giving country short name we can use the full name like given below, 1 python script.py India further supported country information list available in that link. Please click me to see the details The connection script is given below, Here we are checked the ip address instance after connected through the vpn. 1 2 3 4 5 6 7 8 9 10 11 12 13
Read more

Website crawl or scraping with selenium and python

By -
Image
The amount of information on the Web grows exponentially, a flurry of applications (mobile, web, or otherwise) have come about that wish to harness it all. The methods for harnessing information on the web may be many, but one that’s seemingly the most ubiquitous is ‘scraping’. Scraping is what most search engines employ in some form or the other: the ‘spiders’ that crawl the web looking for metadata information embedded in websites, or price-comparison sites that allow users to make purchase decisions, and probably a gazillion other things that I cannot even imagine. How Scraping differs ? In this article we are going to look at the website crawling with python. The crawling work can be classified based on the HTML DOM modification and rendering.  Scraping Type 1: The DOM modification is done in server side and the html string append in frond end means we dont go with selenium. We can achieve through python and tool for parsing html code.  Scraping Type 2
Read more