Help Needed, Extracting a whole subreddit!!

Forum is for miscellaneous user help requests.

Help Needed, Extracting a whole subreddit!!

Postby yutttt » Tue Apr 11, 2017 9:26 am

Hello, I wanted to extract all the submission and comments in one subreddit. When I type in "r/television" in subreddit search, the results aren't all from the subreddit that I want. So instead I type "television" in submission search when gave the results all about television subreddit. I chose "Crawl link subreddit","Crawl link comments","crawl link accounts","crawl comment trees". But the application didn't run. It gave an error message "Counldn't find a suitable extractor...". Is there anyone who could help me solve it?
yutttt
 
Posts: 2
Joined: Tue Apr 11, 2017 9:20 am

Re: Help Needed, Extracting a whole subreddit!!

Postby akivela » Tue Apr 11, 2017 4:41 pm

Hello

Once you have written r/television to the search field, press Search button right to the field. Results appear to the selection area below the search field. Now select one or more items in the selection area. I assume, you forgot make the selection and Wandora threw "Couldn't find a suitable extractor..." message. Notice, Reddit refuses to answer if you make api calls too often.

Kind Regards,
Aki
akivela
Site Admin
 
Posts: 260
Joined: Tue Sep 18, 2007 10:20 am
Location: Helsinki, Finland

Re: Help Needed, Extracting a whole subreddit!!

Postby yutttt » Tue Apr 11, 2017 9:16 pm

But if I type in r/television, there are posts from r/TheSimpsons. I only need the submission and comments from television subreddit. Also, if there a limit for the number of submissions and comments that I can extract? I attached the search results here.
Attachments
Capture.JPG
Capture.JPG (67.96 KiB) Viewed 75684 times
yutttt
 
Posts: 2
Joined: Tue Apr 11, 2017 9:20 am

Re: Help Needed, Extracting a whole subreddit!!

Postby akivela » Wed Apr 12, 2017 9:39 am

Yes, you are right. Searching r/television matches many subreddits, including r/TheSimpsons. However, first subreddit in the list (r/television - a premium-quality television subreddit) is the one you are really interested in, I assume. Select the subreddit by clicking it with your mouse pointer. Now Wandora views information about the subreddit in the text area right to the search results. And now you are ready to proceed extracting the subreddit (you've just selected).

If you want to extract submissions, remember to check the option Crawl Subreddit Links. Also, option Crawl Link Comments is probably useful.

As the r/television subreddit seems to be very active, you probably need to experiment a little to get the extraction settings and options right.

Kind Regards,
Aki
akivela
Site Admin
 
Posts: 260
Joined: Tue Sep 18, 2007 10:20 am
Location: Helsinki, Finland

Re: Help Needed, Extracting a whole subreddit!!

Postby akivela » Wed Apr 12, 2017 7:35 pm

Hi

Also, there is some documentation available: http://wandora.org/wiki/Reddit_extractor

Kind Regards,
Aki
akivela
Site Admin
 
Posts: 260
Joined: Tue Sep 18, 2007 10:20 am
Location: Helsinki, Finland


Return to How to... and problems

Who is online

Users browsing this forum: No registered users and 2 guests

cron