MediaWiki Content Extractor - Revision history

Akivela at 16:49, 16 July 2015

2015-07-16T16:49:13Z

Akivela at 13:53, 15 September 2013

2013-09-15T13:53:52Z

Eero at 10:21, 27 August 2013

2013-08-27T10:21:13Z

Eero at 10:03, 27 August 2013

2013-08-27T10:03:53Z

Eero at 10:03, 27 August 2013

2013-08-27T10:03:28Z

Eero: Created page with "'''Note that this feature is yet to be released''' The MediaWiki content extractor found in '''File > Extract > Wiki > MediaWiki API Extractor''' enables extraction of wiki c..."

2013-08-27T10:02:40Z

Created page with "'''Note that this feature is yet to be released''' The MediaWiki content extractor found in '''File > Extract > Wiki > MediaWiki API Extractor''' enables extraction of wiki c..."

New page

'''Note that this feature is yet to be released'''

The MediaWiki content extractor found in '''File > Extract > Wiki > MediaWiki API Extractor''' enables extraction of wiki content using the [http://www.mediawiki.org/wiki/API:Main_page MediaWiki API]. The API should be available on Wikipedia and most other MediaWiki instances by default.

The extraction is filtered using select methods exposed by the MediaWiki API. Content may be restricted by it's category or title prefix. Content may also be searched for and explicitly specified by titles.

Stub category articles may also be extracted along the targeted articles to construct a class hierarchy of the categories in Wandora.

The extractor needs the MediaWiki instance URL to reach the targeted wiki instance. The path should more specifically reach <code>api.php</code> and <code>index.php</code>. For the English Wikipedia this URL would be <code>http://en.wikipedia.org/w/</code> as of this writing.

The extractor starts processing through the given topics in batches of 100 in the order they are returned from the API. The extraction may be terminated by pressing stop any time during the extraction.

The article data is stored as a MediaWiki content occurrence in Wandora. Depending on whether the API shows

== Extraction ==

;Category search
:The category search allows extraction by a set category in the wiki. Categories are denoted in the wiki as <code>Category:<categoryname></code> in English or it's equivalent in other languages. The <code>Category:</code> prefix should be omitted in the search field.

:Blank input is interpreted as a search for all articles in the wiki.

;Prefix search

:The prefix search allows extraction of topics prefixed with a set prefix. This allows for example searching for all articles beginning with the letter 'c'.

;Free search

:The free search method allows freely searching for articles. This is more or less equivalent to searching for topics with search box available on the wiki webpage.

;Titles search

:The titles search allows extracting set articles specified as a comma separated list.

== Example ==

* The extactor is found in '''File > Extract > Wiki > MediaWiki API Extractor'''.

[[File:mediawiki_e_1.png]]

* Search for members in the category ''physics'' in the English Wikipedia. Also crawl the categories of each extracted article.

[[File:mediawiki_e_2.png]]

* The extraction results are shown when the extraction ends.

[[File:mediawiki_e_3.png]]

* Fill the extracted category stub of ''Category:Physics'' by explicitly searching for it.

[[File:mediawiki_e_4.png]]

* The article content is now visible on the category article

[[File:mediawiki_e_5.png]]

* Supplement the original extraction by freely searching for articles related to physics

[[File:mediawiki_e_6.png]]

== See also ==

*[[Mediawiki content exporter]]

← Older revision		Revision as of 13:53, 15 September 2013
Line 1:		Line 1:
−	~~'''Note that this feature is yet to be released'''~~
−
	The MediaWiki content extractor found in '''File > Extract > Wiki > MediaWiki API Extractor''' enables extraction of wiki content using the [http://www.mediawiki.org/wiki/API:Main_page MediaWiki API]. The API should be available on Wikipedia and most other MediaWiki instances by default.		The MediaWiki content extractor found in '''File > Extract > Wiki > MediaWiki API Extractor''' enables extraction of wiki content using the [http://www.mediawiki.org/wiki/API:Main_page MediaWiki API]. The API should be available on Wikipedia and most other MediaWiki instances by default.

← Older revision		Revision as of 10:03, 27 August 2013
Line 60:		Line 60:
	== See also ==		== See also ==

−	*[[~~Mediawiki~~ Content Exporter]]	+	*[[MediaWiki Content Exporter]]

← Older revision		Revision as of 10:03, 27 August 2013
Line 60:		Line 60:
	== See also ==		== See also ==

−	*[[Mediawiki ~~content exporter~~]]	+	*[[Mediawiki Content Exporter]]

@@ Line 9: / Line 9: @@
 The extractor starts processing through the given topics in batches of 100 in the order they are returned from the API. The extraction may be terminated by pressing stop any time during the extraction.
-The article data is stored as a MediaWiki content occurrence in Wandora. Depending on whether the API shows
+The article data is stored as a MediaWiki content occurrence in Wandora.
 == Extraction ==

@@ Line 34: / Line 34: @@
 == Example ==
-* The extactor is found in '''File > Extract > Wiki > MediaWiki API Extractor'''.
+The extactor is found in '''File > Extract > Wiki > MediaWiki API Extractor'''.
 [[File:mediawiki_e_1.png]]
-* Search for members in the category ''physics'' in the English Wikipedia. Also crawl the categories of each extracted article.
+Search for members in the category ''physics'' in the English Wikipedia. Also crawl the categories of each extracted article.
 [[File:mediawiki_e_2.png]]
-* The extraction results are shown when the extraction ends.
+The extraction results are shown when the extraction ends.
 [[File:mediawiki_e_3.png]]
-* Fill the extracted category stub of ''Category:Physics'' by explicitly searching for it.
+Fill the extracted category stub of ''Category:Physics'' by explicitly searching for it.
 [[File:mediawiki_e_4.png]]
-* The article content is now visible on the category article
+The article content is now visible on the category article
 [[File:mediawiki_e_5.png]]
-* Supplement the original extraction by freely searching for articles related to physics
+Supplement the original extraction by freely searching for articles related to physics
 [[File:mediawiki_e_6.png]]