socialmedian: Regular Expression not working in scraper?

Hi there. I'm Jason, one of the founders of socialmedian.

socialmedian helps you track, discover and share personally relevant news and information with people who share your interests.

We'd love to have you join in. To get started, please create an account.

Create your socialmedian account

Already User of socialmedian? Log in

Clips

Regular Expression not working in scraper?

Source: life is short - you need Python!

Jul 14, 2008

Summary

This is a very common problem for the beginners who try to write web crawler / spider / scraper. The content is fetched but regex is not working right. :(
But the problem is not with the regular expression. You just need to add the following two lines after you fetch content of a web page:
content = content.replace("\n", "")
content = content.replace("\r", "")
Now the regex should work if everything else is ok! Read the full article

Comments (0)

Add Your Comment