What is ITPilot?

ITPilot, a Denodo component, is a web crawler that automates browsing activities such as clicking through webpages, following links, viewing data, and downloading files. ITPilot is useful for presenting data from web pages within Denodo.

On this page:


Using ITPilot

You can use ITPilot to capture either a data set from a web page or a downloaded file. First, a developer records a web browser session, including all clicks and other browser activities. The record of this browser session is then modified as necessary to promote reusability.

When you use ITPilot to find data on a page, that data is imported into a Denodo VDB as a base view. Each time a user accesses the view, the navigation sequence is performed.

When you use ITPilot to download a file, typically the file will be automatically downloaded each day using the Denodo Scheduler. You can view a downloaded file in Denodo by creating a delimited or Excel data source.

Features

When deployed as Denodo VDB base views, ITPilot sequences feature the following capabilities:

  • Variables in navigation can be supplied at runtime (e.g., you can enter search strings into a web search and retrieve the number of hits).
  • Sensitive or navigation information can be supplied via parameter.
  • Users' Denodo login credentials can be passed through to the navigation sequence.

Limitations

The Denodo browser in ITPilot is not compatible with most JavaScript websites. Development and deployment of ITPilot sequences use different browsers (IE and Denodo, respectively), and this causes compatibility issues. If a website changes, the navigation sequence may break, and you may need to redevelop it.

Getting started and learning more

To get started using ITPilot, send a request to denodo-request@indiana.edu.

To learn more, see the ITPilot materials from Denodo Reference Manuals.

This is document alrd in the Knowledge Base.
Last modified on 2016-07-12 12:25:51.

  • Fill out this form to submit your issue to the UITS Support Center.
  • Please note that you must be affiliated with Indiana University to receive support.
  • All fields are required.

Please provide your IU email address. If you currently have a problem receiving email at your IU account, enter an alternate email address.

  • Fill out this form to submit your comment to the IU Knowledge Base.
  • If you are affiliated with Indiana University and need help with a computing problem, please use the I need help with a computing problem section above, or contact your campus Support Center.

Please provide your IU email address. If you currently have a problem receiving email at your IU account, enter an alternate email address.