WandoraWiki - User contributions [en]

Delicious extractors

2008-05-28T13:29:19Z

Antti:

Wandora supports extracting information from del.icio.us and Digg into a topic map. There are two ways to extract information from either source:
<ul><li>The URL extractors look up URLs from topics in context and try to find posts matching those urls from Digg or del.icio.us. If successful, they will add information (description, tags) retrieved from the web api to the topic at hand.</li>
<li>The post extractors will extract posts with a certain criteria (currently only the most recent posts by specified users) and create topics into the topic map, merging with those topics that have matching subject identifiers.</li></ul>

[[Image:Delicious_choose_user.jpg|thumb|right|del.icio.us user choice dialog]]

Delicious extractors

2008-05-28T13:25:26Z

Antti:

Wandora supports extracting information from del.icio.us and Digg into a topic map. There are two ways to extract information from either source:
<ul><li>The URL extractors look up URLs from topics in context and try to find posts matching those urls from Digg or del.icio.us. If successful, they will add information (description, tags) retrieved from the web api to the topic at hand.</li>
<li>The post extractors will extract posts with a certain criteria (currently only the most recent posts by a specified user) and create topics into the topic map, merging with those topics that have matching subject identifiers.</li></ul>

[[Image:Delicious_choose_user.jpg|thumb|right|del.icio.us user choice dialog]]

Delicious extractors

2008-05-28T13:24:23Z

Antti:

Wandora supports extracting information from del.icio.us and Digg into a topic map. There are two ways to extract information from either source.
The URL extractors look up URLs from topics in context and try to find posts matching those urls from Digg or del.icio.us. If successful, they will add information (description, tags) retrieved from the web api to the topic at hand.
The post extractors will extract posts with a certain criteria (currently only the most recent posts by a specified user) and create topics into the topic map, merging with those topics that have matching subject identifiers.

[[Image:Delicious_choose_user.jpg|thumb|right|del.icio.us user choice dialog]]

File:Delicious choose user.jpg

2008-05-28T13:23:30Z

Antti:

Flickr extractors

2008-05-28T12:07:38Z

Antti: /* Flickr authentication */

Wandora has support for extracting information from [http://www.flickr.com/ Flickr] into a topic map using the [http://www.flickr.com/services/api/ Flickr online API.] Three different extractors are currently provided for extracting information from a profile, a specific photo and a Flickr group. All the extractors can be found in the '''File > Extract''' menu.

== Flickr authentication ==
[[Image:Flickr_authstatus_dialog.jpg|thumb|right|Flickr authentication status]]
Many of the Flickr API functions used in the extractors require you to authorize Wandora to access your information. When Wandora needs to call such a function, it will check if it already has sufficient permissions from a previous call, and if not, prompt you to commence authorization. Authorization involves following a URL generated by Wandora and following instructions on the flickr website. Authentication information is stored on a per-session basis, and will be cleared whenever Wandora is closed. The information can also be manually cleared via configuration of any of the Flickr extractors. You may also store the authentication information from the current session and re-enter it later.

To access the configuration dialog, ctrl-click one of the Flickr extractors in the File > Extract menu.
The Flickr authentication status window displays the username of the currently authenticated user, authentication data (token and frob) and the rights that the user has granted (as of this release, only the '''read''' permission level is used.) Clicking '''Clear information''' will remove the authentication information from memory and '''Validate new frob and token''' will attempt to validate a user-entered frob and token with the Flickr API. If the validation is successful, these will be used for the duration of the current session.

Note: clearing authentication information from Wandora does ''not'' clear it from Flickr itself.

Some of the API functions called during information extraction require '''read''' permissions. If authentication information is not stored in this session, Wandora will prompt you to authorize it to obtain the required information.

[[Image:Flickr_auth_waiting.jpg|thumb|left|Wandora is waiting for the user to finish authorization]]
[[Image:Flickr_auth_complete.jpg|thumb|left|The page displayed by Flickr when authorization is complete]]
<br style="clear:both;"/>
Follow the URL in the text box in your web browser, log in and follow the instructions on the flickr website. Once you see the authorization complete screen (above) you can go back to Wandora and click '''Complete''' to proceed with the extraction.

[[Image:Flickr_extract_choice.jpg|thumb|right|Choosing a Flickr extractor]]

== Extractors ==
The primary mode of operation for the Flickr extractors is to choose a topic or a set of topics in the topic map and run an extractor on those topics, effectively expanding nodes as you go. The extractors always apply to the topics that are currently in context. The current context usually consists of the currently selected topics in the GUI.

=== Profile extractor ===
The main entry point for extracting data from Flickr is the profile extractor. The profile extractor gets a list of photos owned and marked as favorites by the profile owner. If no usernames are found, it will prompt you for a comma-delimited list of users to find information for.
[[Image:Flickr_choose_user.jpg|thumb|right|Choosing a username if one wasn't found in context]]

=== Flickr group extractor ===
The group extractor gets a list of photos in the group's photo pool. If no suitable groups are found in context, a dialog is presented to the user, in which text search can be performed to look for groups in Flickr. Skeleton information for all of the groups in the list will be created in the topic map, and full information will be retrieved for the ones the user has selected.
[[Image:Flickrgroupsearch.jpg|thumb|right|Group search dialog]]
[[Image:Group_extract_result.gif|thumb|right|Sample results of the group extractor]]

=== Flickr photo information extractor ===
The photo info extractor gets additional data for a photo where available, including EXIF data and the photo's description.

Flickr extractors

2008-05-28T12:05:17Z

Antti: /* Flickr group extractor */

Wandora has support for extracting information from [http://www.flickr.com/ Flickr] into a topic map using the [http://www.flickr.com/services/api/ Flickr online API.] Three different extractors are currently provided for extracting information from a profile, a specific photo and a Flickr group. All the extractors can be found in the '''File > Extract''' menu.

== Flickr authentication ==
[[Image:Flickr_authstatus_dialog.jpg|thumb|right|Flickr authentication status]]
Many of the Flickr API functions used in the extractors require you to authorize Wandora to access your information. When Wandora needs to call such a function, it will check if it already has sufficient permissions from a previous call, and if not, prompt the you to commence authorization. Authorization involves following a URL generated by Wandora following instructions on the flickr website. Authentication information is stored on a per-session basis, and will be cleared whenever Wandora is closed. The information can also be manually cleared via configuration of any of the Flickr extractors. You may also store the authentication information from the current session and re-enter it later.

To access the configuration dialog, ctrl-click one of the Flickr extractors in the File > Extract menu.
The Flickr authentication status window displays the username of the currently authenticated user, authentication data (token and frob) and the rights that the user has granted (as of this release, only the '''read''' permission level is used.) Clicking '''Clear information''' will remove the authentication information from memory and '''Validate new frob and token''' will attempt to validate a user-entered frob and token with the Flickr API. If the validation is successful, these will be used for the duration of the current session.

Note: clearing authentication information from Wandora does ''not'' clear it from Flickr itself.

Some of the API functions called during information extraction require '''read''' permissions. If authentication information is not stored in this session, Wandora will prompt you to authorize it to obtain the required information.

[[Image:Flickr_auth_waiting.jpg|thumb|left|Wandora is waiting for the user to finish authorization]]
[[Image:Flickr_auth_complete.jpg|thumb|left|The page displayed by Flickr when authorization is complete]]
<br style="clear:both;"/>
Follow the URL in the text box in your web browser, log in and follow the instructions on the flickr website. Once you see the authorization complete screen (above) you can go back to Wandora and click '''Complete''' to proceed with the extraction.

[[Image:Flickr_extract_choice.jpg|thumb|right|Choosing a Flickr extractor]]
== Extractors ==
The primary mode of operation for the Flickr extractors is to choose a topic or a set of topics in the topic map and run an extractor on those topics, effectively expanding nodes as you go. The extractors always apply to the topics that are currently in context. The current context usually consists of the currently selected topics in the GUI.

=== Profile extractor ===
The main entry point for extracting data from Flickr is the profile extractor. The profile extractor gets a list of photos owned and marked as favorites by the profile owner. If no usernames are found, it will prompt you for a comma-delimited list of users to find information for.
[[Image:Flickr_choose_user.jpg|thumb|right|Choosing a username if one wasn't found in context]]

=== Flickr group extractor ===
The group extractor gets a list of photos in the group's photo pool. If no suitable groups are found in context, a dialog is presented to the user, in which text search can be performed to look for groups in Flickr. Skeleton information for all of the groups in the list will be created in the topic map, and full information will be retrieved for the ones the user has selected.
[[Image:Flickrgroupsearch.jpg|thumb|right|Group search dialog]]
[[Image:Group_extract_result.gif|thumb|right|Sample results of the group extractor]]

=== Flickr photo information extractor ===
The photo info extractor gets additional data for a photo where available, including EXIF data and the photo's description.

File:Flickrgroupsearch.jpg

2008-05-28T12:03:01Z

Antti:

RIS extractor

2008-04-30T12:21:33Z

Antti:

Wandora has support for extracting information from files and web sources in [http://en.wikipedia.org/wiki/RIS_%28file_format%29 RIS bibliography reference format]. The extractor has a file and URL open dialog and also supports dropping files and URLs into the Wandora main screen. The parser is fairly robust and can ignore text around and between individual entries. Most of the standard RIS tags are supported, and also some extra information can be searched for in miscellaneous tags such as [http://en.wikipedia.org/wiki/Digital_object_identifier Digital object identifiers.]
[[Image:Ris_graph.jpg|thumb|Graph display of the result of reading in a large RIS file]]
[[Image:Ris select.jpg|thumb|Selecting the RIS extractor]]

Extraction is by default done using UTF-8 encoding. This might fail if the file is not valid UTF-8, and the default encoding can be changed by ctrl-clicking the RIS extractor to open the configuration dialog.

RIS extractor

2008-04-30T12:20:15Z

Antti:

2008-04-30T07:37:56Z

Antti: /* Extractors */

This page contains Wandora documentation. Documentation is a work in progress and incomplete. Also note some documentation may be out of date as the application is developed intensely. If you need specific help, leave a note in the [http://www.wandora.net/wandora/forum/index.php discussion forum] and we'll resolve your request as soon as possible.

== Preparing Wandora ==

* [[System requirements]]
* [[Download|Download Wandora]] (build date {{build date}})
* [[How to install Wandora|Installing Wandora]]
* [[Running Wandora]]

== Topic maps ==

* [[Topic Maps|About topic maps]]
* [[Reduced Topic Maps|Topic maps in Wandora]]

== Basics ==

* [[Quickstart]]
* [[How to open and modify topic]]
* [[Create new topic]]
* [[Delete topic]]
* [[Create new association]]
* [[Delete association]]
* [[Working with topic tables]]
* [[Working with topic trees]]
* [[Creating custom topic trees]]
* [[Topic shortcuts]]
* [[Topic panels]]

== Import and Export ==

Wandora has been designed to enable easy aggregation of knowledge and features wide range of import and extract tools. Wandora is capable to export not just different topic map formats but also N3, HTML, and XML. Wandora's native file format is Wandora project (WPR) which is a collection of XTM topic maps and configuration file within a zip package. Managing of topic maps is easy as Wandora allows the user to copy and paste topics and associations using system clipboard.

* [[How to save and load project]]
* [[How to import existing topic map to Wandora]]
* [[How to export topic map in Wandora]]
* [[Transferring data with clipboard]]
* [[Importing RDF(S)]]
* [[OBO flat file import|Importing OBO flat file ontologies]]
* [[Importing XML with XSL]]
* [[Generic SQL database import]]
* [[Exporting WWW site]]
* [[Lucene search index export]]

[[Image:import_export_diagram.gif|center]]

== Extractors ==

Wandora is great for information mashups. With Wandora you can easily mashup information from various sources. Extractors are specific Wandora tools used to extract topics and associations out of different file formats and sources. Wandora can extract data from MP3 and JPG files for example. To see what extractors your Wandora has installed see '''File > Extract'''. To start an extractor just select the extractor name in the menu or use drag and drop extractor. If you don't find the extractor in the menu use Tool manager to add the extractor into the menu.

* [[Drag and drop extractor]]
* Different extractors
** [[MP3 ID3v1 and ID3v2 extractor]]
** [[JPG binary metadata extractor]]
** [[PDF extractor]]
** [[Email extractor]]
** [[File system extractor]]
** [[HTML link extractor]]
** [[IMDB extractor]]
** [[FreeDB extractor]]
** [[Generic SQL database import | Importing SQL database]]
** [[Audioscrobber extractors|Convert Last.fm XML feeds to a topic map]]
** [[Bibtex extractor|Convert BibTeX files to a topic map]]
** [[Flickr extractors]]
** Convert simple HTML tables to topic map associations
*** [[HTML property table extractor]]
*** [[HTML association table extractor]]
** [[Simple Text Document Extractor|Convert simple text documents to topic map occurrences]]
** [[RSS 2.0 Extractor|Convert RSS 2.0 feeds to topic maps]]

== Generators ==

Generators are special tools that generate topics and associations algorithmically. Generators help you to construct basic building blocks for your topic maps. Generators also serve as a nice test suite for Wandora and topic maps in general. Available generators are

* [[Random graph generator]]
* [[Fully connected graph generator]]
* [[Tree graph generator]]
* [[Linear list graph generator]]
* [[Finite group graph generator]]
* [[Platonic solid graph generator]]

== Schema ==

Schema is a collection of specific topics and associations that Wandora uses to construct the user interface of association editor, occurrence editor and topic name panel. Schema eases many topic map operations such as association and occurrence construction. Schema also defines the language support of Wandora application.

* [[Schema]] to ease association and text data creation and modification
* [[How to add another variant name language]]
* [[How to add another variant name type]]

== Layers ==

Wandora supports layered topic maps. Layered topic map contains one or more topic maps stacked into an ordered array. This separation of merged topic maps allows flexible management of topic maps and enables the birth of public knowledge repositories used as a component of other Wandora based knowledge bases.

* [[Layered Topic Map|Introduction to layered topic maps]]
* [[Creating new layers]]
* [[Deleting layer]]
* [[Layer order and arranging layers]]
* [[Merging layers]]
* [[Layer distribution vector]]

[[Image:Layer_example_diagram.gif|center]]

== Analyzing Topic Maps ==

* [[Topic map info]]
* [[Topic map connection statistics]]
* [[Topic map diameter]]
* [[Clustering coefficient]] of topic map

== Tools and tool manager ==

Almost every feature in Wandora is implemented with a tool. Tool packs certain Wandora functionality into a single software component. Wandora's user may customize the available tool set and even add third party tools to Wandora.

* [[Tool manager]]
* [[:Category:Tools|Available tools]]
* [[Writing your own tool]]
* [[Installing your own tool]]
* [[Tool locks]]

== Other ==

* [[Wandora options]]
* [http://www.wandora.org/wandora/docs/api/ Wandora Javadocs]

== Wandora Server ==

* [[Setting up Wandora Piccolo server]] (including the web service interface).
* [[Wandora Web Service]]
* [[Piccolo XML processor]].

Documentation

2008-04-30T07:37:35Z

Antti: added flickr

This page contains Wandora documentation. Documentation is a work in progress and incomplete. Also note some documentation may be out of date as the application is developed intensely. If you need specific help, leave a note in the [http://www.wandora.net/wandora/forum/index.php discussion forum] and we'll resolve your request as soon as possible.

== Preparing Wandora ==

* [[System requirements]]
* [[Download|Download Wandora]] (build date {{build date}})
* [[How to install Wandora|Installing Wandora]]
* [[Running Wandora]]

== Topic maps ==

* [[Topic Maps|About topic maps]]
* [[Reduced Topic Maps|Topic maps in Wandora]]

== Basics ==

* [[Quickstart]]
* [[How to open and modify topic]]
* [[Create new topic]]
* [[Delete topic]]
* [[Create new association]]
* [[Delete association]]
* [[Working with topic tables]]
* [[Working with topic trees]]
* [[Creating custom topic trees]]
* [[Topic shortcuts]]
* [[Topic panels]]

== Import and Export ==

Wandora has been designed to enable easy aggregation of knowledge and features wide range of import and extract tools. Wandora is capable to export not just different topic map formats but also N3, HTML, and XML. Wandora's native file format is Wandora project (WPR) which is a collection of XTM topic maps and configuration file within a zip package. Managing of topic maps is easy as Wandora allows the user to copy and paste topics and associations using system clipboard.

* [[How to save and load project]]
* [[How to import existing topic map to Wandora]]
* [[How to export topic map in Wandora]]
* [[Transferring data with clipboard]]
* [[Importing RDF(S)]]
* [[OBO flat file import|Importing OBO flat file ontologies]]
* [[Importing XML with XSL]]
* [[Generic SQL database import]]
* [[Exporting WWW site]]
* [[Lucene search index export]]

[[Image:import_export_diagram.gif|center]]

== Extractors ==

Wandora is great for information mashups. With Wandora you can easily mashup information from various sources. Extractors are specific Wandora tools used to extract topics and associations out of different file formats and sources. Wandora can extract data from MP3 and JPG files for example. To see what extractors your Wandora has installed see '''File > Extract'''. To start an extractor just select the extractor name in the menu or use drag and drop extractor. If you don't find the extractor in the menu use Tool manager to add the extractor into the menu.

* [[Drag and drop extractor]]
* Different extractors
** [[MP3 ID3v1 and ID3v2 extractor]]
** [[JPG binary metadata extractor]]
** [[PDF extractor]]
** [[Email extractor]]
** [[File system extractor]]
** [[HTML link extractor]]
** [[IMDB extractor]]
** [[FreeDB extractor]]
** [[Generic SQL database import | Importing SQL database]]
** [[Audioscrobber extractors|Convert Last.fm XML feeds to a topic map]]
** [[Bibtex extractor|Convert BibTeX files to a topic map]]
** [[Flickr extractor]]
** Convert simple HTML tables to topic map associations
*** [[HTML property table extractor]]
*** [[HTML association table extractor]]
** [[Simple Text Document Extractor|Convert simple text documents to topic map occurrences]]
** [[RSS 2.0 Extractor|Convert RSS 2.0 feeds to topic maps]]

== Generators ==

Generators are special tools that generate topics and associations algorithmically. Generators help you to construct basic building blocks for your topic maps. Generators also serve as a nice test suite for Wandora and topic maps in general. Available generators are

* [[Random graph generator]]
* [[Fully connected graph generator]]
* [[Tree graph generator]]
* [[Linear list graph generator]]
* [[Finite group graph generator]]
* [[Platonic solid graph generator]]

== Schema ==

Schema is a collection of specific topics and associations that Wandora uses to construct the user interface of association editor, occurrence editor and topic name panel. Schema eases many topic map operations such as association and occurrence construction. Schema also defines the language support of Wandora application.

* [[Schema]] to ease association and text data creation and modification
* [[How to add another variant name language]]
* [[How to add another variant name type]]

== Layers ==

Wandora supports layered topic maps. Layered topic map contains one or more topic maps stacked into an ordered array. This separation of merged topic maps allows flexible management of topic maps and enables the birth of public knowledge repositories used as a component of other Wandora based knowledge bases.

* [[Layered Topic Map|Introduction to layered topic maps]]
* [[Creating new layers]]
* [[Deleting layer]]
* [[Layer order and arranging layers]]
* [[Merging layers]]
* [[Layer distribution vector]]

[[Image:Layer_example_diagram.gif|center]]

== Analyzing Topic Maps ==

* [[Topic map info]]
* [[Topic map connection statistics]]
* [[Topic map diameter]]
* [[Clustering coefficient]] of topic map

== Tools and tool manager ==

Almost every feature in Wandora is implemented with a tool. Tool packs certain Wandora functionality into a single software component. Wandora's user may customize the available tool set and even add third party tools to Wandora.

* [[Tool manager]]
* [[:Category:Tools|Available tools]]
* [[Writing your own tool]]
* [[Installing your own tool]]
* [[Tool locks]]

== Other ==

* [[Wandora options]]
* [http://www.wandora.org/wandora/docs/api/ Wandora Javadocs]

== Wandora Server ==

* [[Setting up Wandora Piccolo server]] (including the web service interface).
* [[Wandora Web Service]]
* [[Piccolo XML processor]].