Large scale web scraping is always a big deal. However a simple crawl or filling web form & scraping the result is much easier than you think. While scraping a static page is a cat walk, it is little tricky to scrape dynamic web pages!
I wrote a simple script to fill a dynamic page ( http://www.emirates.com/account/english/miles-calculator/miles-calculator.aspx ) & scrape the result using Python, Mechanize & BeautifulSoup.
Check our the code on github. Its just a few lines of code and its self explanatory.
Clone the repo.
Lest calculate howmany miles will be rewarded for travelling from Delhi(DEL) to New York(JFK).
Here is the sample output of the script.
I wrote a simple script to fill a dynamic page ( http://www.emirates.com/account/english/miles-calculator/miles-calculator.aspx ) & scrape the result using Python, Mechanize & BeautifulSoup.
Check our the code on github. Its just a few lines of code and its self explanatory.
Clone the repo.
git clone https://github.com/ChillarAnand/Emirates-Miles-Calculator.gitLest calculate howmany miles will be rewarded for travelling from Delhi(DEL) to New York(JFK).
python emirates.py DEL JFKHere is the sample output of the script.