The eXtractorONE Twitter Conenctor accesses the Twitter Search API, which is part of Twitter’s v1.1 REST API. It allows queries against all tweets. You can use search tags like ‘@’ (referencing persion), ‘#’ (hashtag), ‘from:’ (sent from person), ‘to:’ (sent to person), ‘-‘ (not containing), exact phrase by closing search tags between double quotes etc.
It’s possible to original tweets (in case of a quote or a retweet) to build a complete conversation. As eXtractorONE stores history there is no limitation on the number of tweets or date.
With the LinkedIN API connector you can get data from
- your company’s profile
- your company’s updates
- comments for a company update
- likes for a company update
- your company’s followers count, by segment
- historical follower statistics about your company
- historical status update statistics about your company
- statistics for your company page
The Instagram API connector can be used to build services that help brands and advertisers understand and manage the audience of the images of your product.
Initially, you start in the Sandbox mode. After you have built such a service you can migrate from sandbox to production. Then the downloaded data will also help you to analyze your own data (likes, comments, followers, location etc.).
The YouTube Analytics API enables you to retrieve YouTube Analytics data from your Video Channels and Playlists like the number of views, likes, dislikes, comments etc.
The Facebook connector enables you to download data from several Graph API’s:
User feed API
The feed of posts (including status updates) and links published by this person, or by others on this person’s profile. Including comments, likes and shares.
Game score API
The Graph API for Scores lets game developers build social leaderboards and game-matching by storing players’ scores as they play. These scores will appear on players’ timelines and in the Games Feed on Facebook.
Page Insights API
With the Facebook Page Insights API you can access metrics about your Facebook (Company) Page. For example you can get the total number of people who liked your Page or the number of people who shared stories about your page.
The eXtractorONE Zalando connector accesses the Zalando.com API, which is part of Zalando.com REST Public API. It allows queries against the database of Zalando.com. You can enter multiple brands. With the Tracking feature in eXtractorONE it’s possible to track changes in list availability and price.
The eXtractorONE BOL.com connector accesses the BOL.com API, which is part of BOL.com REST Public API. It allows queries against the database of BOL.com. You can enter multiple brands. With the Tracking feature in eXtractorONE it’s possible to track changes in list price and list price.
The Walmart Connector fetches product data (with lots of attributes) including image URL’s and price. With the ‘Track changes’ feature in eXtractor ONE it’s possible to track changes in stock and prices. You can search for multiple products, brands and browse through product categories.
The eXtractorONE Best Buy Connector provides full product information for over 1M current and historical products, including pricing, availability, specifications, descriptions, and images. Just like the other eCommerce connector you can track changes in availability and pricing. It’s possible to browse the categories and you can enter multiple search terms.
SOAP Web Service Connector
eXtractorONE has a web service connector that allows you to call a web service and store the results in SQL Server. This can be very useful if you need to call data from a web service that will be stored in a relational database. The configuration of the web service connector is easy as all you need is the address of the WSDL and the parameters accepted by the method. You can even populate the parameters in batch by selecting a database table or text file with the needed parameter information.
The output of the WSDL call is always in XML format. You do not need to pass an XPATH query to return the data. The data will be stored automatically in your SQL Server database in a readable table format. If you need history, eXtractorONE takes care of this. Duplicate data won’t be stored if you choose to extract the data incrementally.
REST API Connector
With the REST API Connector you can grab data from lots of API providers without coding. You only have to make an http request by adding the URL. Parse the parameters and enter the values you want to pass to the web server (one of them is the token key). Just like the SOAP Web Service Connector you can populate the parameters dynamically by selecting a database column or text file.
eXtractorONE can handle both JSON as XML output. The data will be written to a table structure in SQL Server. Don’t worry about history. If you schedule an API extraction, duplicate data won’t be stored. If the API provider supports OAuth 2 you can add the token URL and enter your Client and Secret. The eXtractorONE configuration maintains all your tokens. If a token is expired you can renew it there. To prevent that the rate limit will be exceeded it’s possible to configure a minimum time between requests. With this connector you easily connect to hundreds of APIs (like Google Translate, BING Search, BING Maps, Pipedrive, Indeed etc.).
The Web Connector in eXtractorONE can create simple calls to RSS feeds or download XML/JSON published on http(s). It’s also possible to call an API provider when there is no need to populate the parameters dynamically. If you need to grab html code (i.e. web tables) the HTML code will be converted to XML so it can be processed. Multiple calls can be created manually if need.
You can configure optionally the credentials to enter the website and/or configure a proxy server. If you need to download specific elements (like everything in ‘<table’) you can select these type of nodes in the filter feature.
Web Connector Advanced
In the regular web connector you can add multiple calls. However, those URLs can only contain hard coded parameters. A more dynamic approach can be achieved in the advanced web connector by parameterization.
Use the database method to extract XML files from a database column of MS SQL Server. The data type of the column does not need to be XML. For example, this may also be varchar (max).
To determine the root of the document it’s possible to select one or more columns in the source table to create a key. This key will be used to decide whether the source has changed. Moreover, it gives insight in the source of the XML file.
Use the file method to search a file system for XML, JSON or SQL documents. You can specify an entire folder or just certain files. The system will traverse all subfolders. It’s possible to include or exclude certain extensions (like .json, .xml, .sql, .xlsx, rdl, dtsx etc.).
With this method you can convert .sql files to an XML format. This XML will be decomposed to tables so you can query on your SQL queries (i.e., which sql retrieves data of which tables). Supporte database types: SQL Server, Oracle, MySQL, MS Access, DB2.
The FTP connector imports data published on FTP sites. Any XML or JSON file will be grabbed. Subfolders can be traversed. Just like the File connector, a filter can be applied on certain file extensions.
Optionally you can configure the credentials to enter the ftp site and/or configure a proxy server.
With the SQL connector in eXtractorONE you can shred SQL syntax that is stored in a database column (SQL Server only). With this method sql files will be converted to an XML format. This XML will be decomposed to tables so you can query on your SQL queries (i.e., which sql retrieves data of which tables). Supported database types: SQL Server, Oracle, MySQL, MS Access and DB2.
It’s also possible to process SQL views and SQL stored procedures. Those should be in MS SQL Server format always.
Google Analytics Connector
The Google Analytics Connector retrieves data from both the Analytics Export API and the AdWords API in order to gain some key insights from the combination of the two. You can download lots of data that gives insight in the traffic to your website.
The RDW Connector enables you to extract attributes of all Dutch cars with license plates. You can select a text file or database column with the license plates of your company’s fleet to fetch all the data. You can also filter on other attributes without entering a license plate, like ‘give me all the cars with an APK due date in three months’.
IBM Cognos Connector
The Cognos connector simplifies the process to extract metadata from Cognos Connection, Cognos Reports and Cognos Models. You can also do this with the File Connector (for Connection and Framework Model) and the Database Connector (for Cognos Reports), however, so called ‘CoRe’-tables (Cognos Reporting tables) will be installed to leverage querying on the metadata. Considering Business Intelligence Metadata, eXtractorONE is not limited to IBM Cognos, almost any other Business Intelligence system that can export metadata in XML or JSON is supported.