WEB.RTD

WEB.RTD

Getting Started

WEB.RTD implements a simple idea: if you may get data from the Web, you may get the data in Excel.

WEB.RTD parses loaded data and creates navigation paths for all data topics.

You may get ready-to-use Excel formulas using Formula Builder that looks like this:

WEB.RTD Formula Builder

You specify the URL and then paste copied formulas to an Excel worksheet.

Then you remove the cells you do not need and move required cells to the right position like this:

Report Worksheet Example

Also, you may customize the source URL to load data for the required stocks, options, futures, and currencies.

You may change the refresh interval for any URL.

WEB.RTD is a unique product.

If you know the URL, you may create an updatable report based on HTML, XML, JSON, or CSV data with the required structure in a dozen of minutes.

Moreover, you may find ready-to-use examples of loading data from Yahoo Finance, Google Finance, and MSN Money in the WEB.RTD Examples folder of the downloaded package.

Start learning with the Using WEB.RTD topic.

Then you may start Formula Builder to try your URL or open examples in the WEB.RTD Examples folder of the downloaded package.

WEB.RTD requires registration to start a trial. See the Product Registration topic for details.

What's New

Version 1.7, December 13, 2017

Improvements:

  • Updates examples

Bug fixes:

  • Removed URLs disabled by Yahoo Finance.
  • Fixed URLs for loading data from Google Finance.
  • Fixed issues with log file copies.

Version 1.6, November 3, 2017

Improvements:

  • Updates examples
  • Added JSONP parser
  • Added PartialHTML parser (HTML inside JSON and JSONP)
  • Improved HTML parser

Bug fixes:

  • Errors with HTTPS requests that support tls12 only
  • Parser errors for quotes in JSON
  • Registration wizard WebException in the offline mode

Version 1.5, August 22, 2017

Breaking changes:

  • Changed .NET platform from .NET Framework 4.0 Client Profile to .NET Framework 4.5.2.
  • Changes in requirements for Windows 7, Windows Server 2008, and Windows Server 2008 R2.
  • Removed support of Windows XP.

Improvements:

  • Updates examples

Bug Fixes:

  • Issues with registering products.

Version 1.4, August 1, 2017

Improvements:

  • Improved JSON parser performance

Version 1.3, July 5, 2017

Improvements:

  • Updated registration wizard
  • Updated installer
  • Improved diagnostic messages

Version 1.2, May 31, 2017

Improvements:

  • Updated installer
  • Updated documentation

Version 1.1, May 11, 2017

Improvements:

  • Spanish translation in the RegisterProduct wizard
  • Improved documentation

Version 1.0, May 1, 2017

The first release.

Edition Comparison

FeatureFreePersonalEnterprise
Number of active URLs in all opened workbooks202000Unlimited
Formula Builder
HTML parser
JSON parser
XML parser
CSV parser
One-time price per copy* $49$99
Commercial usex

URL examples:

http://query2.finance.yahoo.com/v7/finance/quote?symbols=AAPL
http://query1.finance.yahoo.com/v7/finance/options/AAPL
http://query2.finance.yahoo.com/v10/finance/quoteSummary/AAPL?modules=defaultKeyStatistics

Install and Uninstall

Installing

Close Microsoft Excel and run setup.exe.

Updating

Close Microsoft Excel and run setup.exe of a new version.

Uninstalling

To uninstall WEB.RTD, open Control Panel, Programs and Features, then select WEB.RTD and click the Uninstall button.

System Requirements

Supported Versions of Microsoft Excel:

  • Microsoft Excel 2007, 2010, 2013, 2016

Supported Architectures:

  • x86, x64

Supported Operating Systems:

  • Windows Vista SP2, 7 SP1, 8, 8.1, 10
  • Windows Server 2008 SP2, 2008 R2 SP1, 2012, 2012 R2, 2016

End-User License Agreement

This End-User License Agreement (EULA) is a legal agreement between you (either an individual or a single entity) and Gartle Technology Corporation for any WEB.RTD software, use examples and documentation (Software) that accompany this EULA.

YOU AGREE TO BE BOUND BY THE TERMS OF THIS EULA BY INSTALLING, COPYING, OR OTHERWISE USING THE SOFTWARE.

IF YOU DO NOT AGREE, DO NOT INSTALL, COPY, OR USE THE SOFTWARE.

Your licensing of Software is in accordance with the terms of the EULA in effect at the time of such licensing. By licensing Software, you accept and agree to the EULA in effect at such time.

  1. GRANT OF LICENSE: Gartle Technology Corporation grants you the following rights provided that you comply with all terms and conditions of this EULA:
    1. Trial Period: You may install, use, access, display and run the Software for purposes of evaluation of the Software for a period of fifteen (15) days from the date of installation of the Software to determine if the Software meets your needs. Upon completion of your evaluation or at the end of the 15-day trial period, whichever occurs first, you must do one of four things: either
      1) register the WEB.RTD Free edition in order to continue use of Software;
      2) purchase license for the WEB.RTD Personal or Enterprise edition in order to continue use of Software;
      3) purchase a subscription for the WEB.RTD Personal or Enterprise edition in order to continue use of Software;
      or 4) discontinue use of the Software, and uninstall the Software from any and all machines.
    2. Installation and Use: You may install, use, access, display and run one (1) copy of the Software per license, on a non-exclusive basis and without right of sublicense or concurrent use, on a single computer or machine, such as a workstation.
      The commercial use of the WEB.RTD Personal edition is not permitted, including the use by professional traders and institutional investors.
    3. Software Transfer: You may transfer the Software to a different internal workstation or user so long as you have purchased a License for each such workstation or user. You may not, however, transfer the Software to a Third Party.
    4. Use of Examples: You may install, access, modify and use Software examples, including Microsoft Excel workbooks, databases, SQL codes, and batch files, for your private or company-internal purposes.
  2. LIMITATIONS: You may not use, copy, modify, display, rent, lease, loan, transfer, distribute, download, merge, or make any translation or derivative work of the Software, except as expressly provided herein. You may not reverse engineer, decompile, or disassemble the Software, except and only to the extent that such activity is expressly permitted by applicable law notwithstanding this limitation.
  3. INTELLECTUAL PROPERTY RIGHTS AND CONFIDENTIALITY: The Software, including methods, processes and/or techniques utilized therein, is owned by, proprietary to and valuable trade secrets of Gartle Technology Corporation and is protected by Russian Federation copyright law and international treaties. You agree to take no actions that impair or infringe Gartle Technology Corporation's intellectual property rights in the Software. You agree not to remove, efface or obscure any copyright notices, other proprietary markings or confidentiality legends placed upon or contained within the Software.
  4. DISCLAIMER OF WARRANTIES: Gartle Technology Corporation disclaims all warranties concerning the Software and Services (if any), express, implied, or statutory, including without limitation, any warranties, duties or conditions of merchantability or fitness for a particular purpose, warranties of reliability or availability, of accuracy or completeness of responses, of results, of workmanlike effort, of lack of viruses, and of lack of negligence, all with regard to the Software, and the provision of or failure to provide support or other services, information, software, and related content through the Software or otherwise arising out of the use of the Software. Gartle Technology Corporation does not warrant that the Software will operate in combination with other software products selected by you, or that the Software will operate uninterrupted or error-free. Additionally, Gartle Technology Corporation and its suppliers provide the Software and Services AS IS AND WITH ALL FAULTS. THERE IS NO WARRANTY OR CONDITION OF TITLE, QUIET ENJOYMENT, QUIET POSSESSION, CORRESPONDENCE TO DESCRIPTION, OR NONINFRINGEMENT WITH REGARD TO THE SOFTWARE.
  5. NO LIABILITY: TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, IN NO EVENT SHALL GARTLE TECHNOLOGY CORPORATION OR ITS SUPPLIERS BE LIABLE FOR ANY SPECIAL, INCIDENTAL, PUNITIVE, INDIRECT, OR CONSEQUENTIAL DAMAGES WHATSOEVER (INCLUDING, BUT NOT LIMITED TO, DAMAGES FOR LOSS OF PROFITS OR CONFIDENTIAL OR OTHER INFORMATION, FOR LOSS OF DATA, FOR BUSINESS INTERRUPTION, FOR PERSONAL INJURY, FOR LOSS OF PRIVACY, FOR FAILURE TO MEET ANY DUTY INCLUDING OF GOOD FAITH OR OF REASONABLE CARE, FOR NEGLIGENCE, AND FOR ANY OTHER PECUNIARY OR OTHER LOSS WHATSOEVER) ARISING OUT OF OR IN ANY WAY RELATED TO THE USE OF OR INABILITY TO USE THE SOFTWARE, THE PROVISION OF OR FAILURE TO PROVIDE SUPPORT OR OTHER SERVICES, INFORMATION, SOFTWARE, AND RELATED CONTENT THROUGH THE SOFTWARE OR OTHERWISE ARISING OUT OF THE USE OF THE SOFTWARE, OR OTHERWISE UNDER OR IN CONNECTION WITH ANY PROVISION OF THIS EULA, EVEN IN THE EVENT OF THE FAULT, TORT (INCLUDING NEGLIGENCE), MISREPRESENTATION, STRICT LIABILITY, BREACH OF CONTRACT OF GARTLE TECHNOLOGY CORPORATION OR ANY SUPPLIER, AND EVEN IF GARTLE TECHNOLOGY CORPORATION OR ANY SUPPLIER HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
  6. LIMITATION ON REMEDIES: Within the first thirty (30) days after your receipt of the Software, should you encounter and report to Gartle Technology Corporation within such time period a reproducible error that causes the Software not to perform in all material respects as set forth in the Software documentation, then Gartle Technology Corporation will, at its sole discretion, either: a) resolve the error or malfunction, and modify or replace the Software (if deemed necessary by Gartle Technology Corporation); or b) allow you to terminate this EULA with respect to the non-conforming Software and, upon your return of the Software to Gartle Technology Corporation, Gartle Technology Corporation shall provide you with the lesser of a) the actual damages incurred by you; or b) the amount you paid for the non-conforming Software. The remedies described in this section shall be your sole and exclusive remedies under this EULA.
  7. GENERAL PROVISIONS
    1. Reservation of Rights and Ownership: Gartle Technology Corporation reserves all rights not expressly granted to you in this EULA. The Software is licensed, not sold.
    2. Consent to Use of Data: You agree that Gartle Technology Corporation and its affiliates may collect and use technical information gathered as part of the Software support services provided to you, if any, related to the Software. Gartle Technology Corporation may use this information solely to improve Gartle Technology Corporation products or to provide customized services or technologies to you and will not disclose this information in a form that personally identifies you.
    3. Links to Third Party Sites: We may link to third-party sites through the use of the Software. The third-party sites are not under the control of Gartle Technology Corporation, and Gartle Technology Corporation is not responsible for the contents of any third-party sites, any links contained in third-party sites, or any changes or updates to third-party sites. Gartle Technology Corporation is not responsible for webcasting or any other form of transmission received from any third-party sites. Gartle Technology Corporation is providing these links to third-party sites to you only as a convenience, and the inclusion of any link does not imply an endorsement by Gartle Technology Corporation of the third-party site.
    4. Additional Software/Services: This EULA applies to updates, supplements, add-on components, or Internet-based services components, of the Software that Gartle Technology Corporation may provide to you or make available to you after the date you obtain your initial copy of the Software, unless Gartle Technology Corporation provides other terms along with the update, supplement, add-on component, or Internet-based services component. Gartle Technology Corporation reserves the right to discontinue any Internet-based services provided to you or made available to you through the use of the Software.
    5. Upgrades: To use Software identified as an upgrade, you must first be licensed for the software identified by Gartle Technology Corporation as eligible for the upgrade. After upgrading, you may no longer use the software that formed the basis for your upgrade eligibility.
    6. Applicable Law: This EULA is governed by the laws of the Russian Federation. Any legal action or proceeding relating to this EULA shall be instituted in a court of arbitration in the Moscow City, Russian Federation. Gartle Technology Corporation and you agree to submit to the jurisdiction of, and agree that venue is proper in, these courts in any such action or proceeding. The prevailing party in any action to enforce this EULA will be entitled to recover its attorney fees and costs in connection with such action.
    7. Waiver: The failure of either party to enforce any of the terms of this EULA shall not be construed as a waiver of future enforcement of that or any other term.
    8. Entire Agreement and Severability: This EULA (including any addendum or amendment to this EULA which is included with the Software) is the entire agreement between you and Gartle Technology Corporation relating to the Software and the support services (if any) and it supersedes all prior or contemporaneous oral or written communications, proposals and representations with respect to the Software or any other subject matter covered by this EULA. To the extent the terms of any Gartle Technology Corporation policies or programs for support services conflict with the terms of this EULA, the terms of this EULA shall control. If any provision of this EULA is held to be void, invalid, unenforceable or illegal, the other provisions shall continue in full force and effect.
    9. Termination: Without prejudice to any other rights, Gartle Technology Corporation may terminate this EULA if you fail to comply with the terms and conditions of this EULA. In such event, you must destroy all copies of the Software and all of its component parts and you will not be entitled to any refund of monies.

Trial Version Limitations

You can use WEB.RTD Enterprise during a 15-day trial period for free.

You have to activate the trial.

When the trial period has expired, you have the following options:

  1. To register the WEB.RTD Free edition for free.
  2. To purchase a license and register the WEB.RTD Personal or Enterprise edition.
  3. To purchase a subscription and register the WEB.RTD Personal or Enterprise edition.
  4. To stop the use and remove WEB.RTD from a computer.

See also

Using WEB.RTD

Concept

WEB.RTD do the following:

  1. Downloads data from the specified URL and saves the data to a file.
  2. Parses the file and creates a navigation path for every topic.
  3. Refreshes RTD formula data in Excel.

WEB.RTD supports the following types of web data sources: JSON, XML, HTML, and CSV.

Navigation paths depend on data sources and look like

[0].Chart.Series[0].P

RTD formulas look like:

=RTD("web.rtd",,$A$1,"[0].Chart.Series[0].P")

You do not care about paths and formulas as you insert ready-to-use formulas using WEB.RTD Formula Builder.

However, you may modify formulas to customize your models. The formulas are valid while the page structure remains the same.

You may set the refresh interval for every URL. The default interval is 24 hours.

WEB.RTD makes two requests per second. So, refreshing data of 1000 URLs requires at least 500 seconds.

The default folder of downloaded files is %USERPROFILE%\AppData\Local\WEB.RTD\DataCache.
You may change it using the DataCacheDirectory setting.

You may find examples of loading data for stocks, options, and futures from Yahoo Finance, Google Finance, and MSN Money in the downloaded package.

Important Notes

Read terms of services of the websites before using WEB.RTD.

Some websites strictly prohibit automatic downloads. Do not use WEB.RTD in such cases.

For example, do not use WEB.RTD with www.cboe.com.

Also, do not make a lot of requests to websites. Otherwise, the websites may ban your IP.

Creating Reports

  1. Run WEB.RTD Formula Builder.
  2. Select the formula style, A1 or RC, and the formula separator, comma or semicolon.
  3. Paste the target URL and click Go.
  4. Click Copy Formulas.
WEB.RTD Formula Builder
  1. Create a new worksheet like source.
  2. Select cell A1 and paste the content.
Source Worksheet Example
  1. Copy the source worksheet to a new worksheet like report.
  2. Remove unnecessary cells and create a report as you need.
  3. Remove the source worksheet.
Report Worksheet Example

Useful Tips

  1. Insert Formula Builder formulas at cell A1.
    Cell A1 contains the requested URL. Keep it at cell A1 if possible. This allows adding formulas later in an easy way.
  2. Keep the formula that controls the refresh interval (in seconds) at the worksheet.
    The formula looks like
    =RTD("web.rtd",,$A$1,"RTD_REFRESHINTERVAL",24*60*60)

Changing Refresh Intervals

Set the refresh interval in seconds using formulas like this:

=RTD("web.rtd",,$A$1,"RTD_REFRESHINTERVAL",24*60*60)

where $A$1 contains the configured URL. 

Formula Builder

WEB.RTD Formula Builder builds RTD formulas for the specified URL.

You may start it using Start, All Programs, WEB.RTD, Formula Builder.

Formula Builder looks like this:

WEB.RTD Formula Builder

To get formulas, specify the URL and click the Go button.

You may change the A1 or RC formula style and the comma or semicolon separator depending on your Excel settings.

Then click Copy Formulas and paste the copied formulas at cell A1.

You have to see navigation paths in the left column and updatable values in the right column.

If the builder detects a table, it creates an updatable table.

Cell A1 contains the source URL. Cell A2 contains the formula used to change the refresh interval.

Application Fields

Application fields allow getting information about application settings, downloads, and value changes using RTD formulas.

Server Fields

Formula format:

=RTD("web.rtd",,"<Data field>")

For example:

=RTD("web.rtd",,"rtd_server_Version")
=RTD("web.rtd",,"rtd_server_DataCacheDirectory")

Complete list of fields:

FieldMeaning
rtd_server_VersionThe WEB.RTD version
rtd_server_RegistrationInformation about the registered edition and trial period
rtd_server_DataCacheDirectoryThe DataCacheDirectory setting
rtd_server_TimeZoneThe TimeZone setting
rtd_server_DateTimeThe current date and time adjusted to the server time zone
rtd_server_DateThe current date adjusted to the server time zone
rtd_server_TimeThe current time adjusted to the server time zone

Tick Fields

Tick fields allow understanding value change directions and may be used with conditional formatting.

Add the :tick suffix to the underlying data field name. For example:

=RTD("web.rtd",,$A$1,"[0].Chart.Series[0].Last")
=RTD("web.rtd",,$A$1,"[0].Chart.Series[0].Last:tick")

Tick values:

Tick ValueMeaning
1The value is changed up
0The value is unchanged
-1The value is changed down

URL Specific Fields

Use the following fields to get the information about the specific URL:

FieldMeaning
rtd_RefreshIntervalThe refresh interval (get and set)
rtd_LastUpdateThe date and time of the last update
rtd_LastUpdateDateThe date of the last update
rtd_LastUpdateTimeThe time of the last update
rtd_LastErrorThe last error code (see codes below)
rtd_LastMessageThe last error message

For example, if a data formula is

=RTD("web.rtd",,$A$1,"[0].Chart.Series[0].Last")

you may monitor the status like:

=RTD("web.rtd",,$A$1,"rtd_LastUpdate")
=RTD("web.rtd",,$A$1,"rtd_LastError")
=RTD("web.rtd",,$A$1,"rtd_LastMessage")
=RTD("web.rtd",,$A$1,"rtd_RefreshInterval")

Also, you may change the refresh interval (in seconds) using the formula like this (15 minutes):

=RTD("web.rtd",,$A$1,"rtd_RefreshInterval",15*60)

Do not make a lot of requests to the website. Otherwise, the website may ban your IP.

LastError Codes

The rtd_LastError field returns the following codes:

ValueMember name Description
0SuccessNo error was encountered
14TimeoutNo response was received during the time-out period for a request
15ProxyNameResolutionFailureThe name resolver service could not resolve the proxy host name
400BadRequestThe request could not be understood by the server due to malformed syntax
401UnauthorizedThe request requires user authentication
403ForbiddenThe server understood the request but is refusing to fulfill it
404NotFoundThe server has not found anything matching the Request-URI
407ProxyAuthenticationRequiredThis code is similar to 401 (Unauthorized) but indicates that the client must first authenticate itself with the proxy
408RequestTimeoutThe client did not produce a request within the time that the server was prepared to wait
500InternalServerErrorThe server encountered an unexpected condition which prevented it from fulfilling the request
503ServiceUnavailableThe server is currently unable to handle the request due to a temporary overloading or maintenance of the server

Application Settings

You may change the settings in the web.rtd.dll.config file located in the application folder, usually, at

C:\Users\<Your user name>\AppData\Gartle\WEB.RTD\web.rtd.dll.config

You may open the file using Start Menu, All Programs, WEB.RTD, Configuration File.

Configuration file example:

<?xml version="1.0" encoding="utf-8" ?>
<configuration>
    <appSettings>
        <add key="StorageType" value="SQLite"/>
        <add key="DataCacheDirectory" value=""/>
        <add key="TimeZone" value="Eastern Standard Time"/>
    </appSettings>
</configuration>

Configuration parameters:

StorageType
This string value defines where to store downloaded data: an SQLite database or the file system.
Possible values: SQLite (default) and Folder.
The files are located in the DataCacheFolder.
DataCacheDirectory
This string value defines the directory for downloaded data.
The default value is %USERPROFILE%\AppData\Local\WEB.RTD\DataCache on Windows Vista and later,
and %USERPROFILE%\Local Settings\Application Data\WEB.RTD\DataCache on Windows XP.
TimeZone
The string value defines the time zone used in the rtd_LastUpdate, rtd_LastUpdateDate, and rtd_LastUpdateTime fields.
The default value is the current Windows time zone.
See available time zones at http://technet.microsoft.com/en-us/library/cc749073(v=ws.10).aspx.

You may get setting values in Excel using application fields.

Troubleshooting

Formula Builder does not contain formulas for data shown on a web page
In the most cases, the page loads data using AJAX and does not include the data in the page source.
Right-click on the web page and open View page source.
If you see data in the page source, you may contact us to fix the issue.
If you do not see the data, you may detect the source data URL using Fiddler.
In the most cases, you will find the web-service URL that returns JSON.
A web page requires a username and password
The current version does not support loading data from protected URLs.
The formulas return bad data. Yesterday they were okay
Try to get new formulas using Formula Builder.
In the most cases, the website has changed the page structure.
I try to refresh the page every second. But this does not work
WEB.RTD refreshes two page per second maximum.
If you have 10 pages, the pages may be updated every 5 seconds.
However, do not request the website so frequently. Otherwise, the website may ban your IP.
A website banned my IP
In most cases, this is a temporary ban.
However, you must read the website terms of services.
Some websites strictly prohibit automatic downloads. Do not use WEB.RTD in such cases.
If the website has no such restrictions, just increase the refresh interval to make fewer requests to the website.

Product Registration

WEB.RTD requires registration to start a trial and to use it after the trial period.

To register, open Start Menu, All Programs, WEB.RTD, Register Product.

Selecting Edition

You may register the trial version or the WEB.RTD Free edition for free, the product code is not required.

To register the WEB.RTD Personal or Enterprise edition fill in the product code received after purchasing.

WEB.RTD Registration - Select the edition

Licensee Data

Please fill in the registration form like this:

WEB.RTD Registration - Fill personal data

The Next button is enabled when all the required fields are filled.

Don't forget to check the required field about the personal data use.

Online Registration

This step allows you to check your email address. If the email is valid, click Next.

You may return to the previous step using the Back button.

WEB.RTD Registration - Check the email

After clicking the Next button, the WEB.RTD connects to the registration server.

If the connection is successful, the final step screen is shown.

If any error occurred during connection, you might try to register the product later or try to register the product by email.

WEB.RTD Registration - The final step

You may set the registration for all users of the computer. This action requires administrator privileges.

Click Finish.

Registration by Email

If you choose the Register by email option on the Licensee Data step, the following screen is displayed:

WEB.RTD Registration - Check and start the registration email

The Next button starts the default email program, creates a registration email, and activates the next step.
Don't forget to send the email.

If starting of the email program has failed, you may create the registration email manually using the shown registration data.
Please carefully copy the To, Subject, and the Message fields.

The registration server sends the reply in a couple of seconds; but you may close the dialog box and open it again, in the same step.

Please copy the activation code from the received registration email and paste it into the Activation code field.

WEB.RTD Registration - Paste the activation code

The Next button is enabled when the activation code is valid.

Click Next to continue.

The wizard checks the registration data and confirms the registration.

WEB.RTD Registration - The final step

You may set the registration for all users of the computer. This action requires administrator privileges.

Click Finish.