Search the Knowledge Base: URL to Text Kit  Help and Support
Support Home > Knowledge Base > Q100417

HOW TO: Convert a Web Page to Text by Using URL to Text Kit

Article ID: Q100417  |  Last Review: March 9, 2004  |  Revision: 2.1

Summary

URL to Text Kit retrieves a Web page and returns its content as Markdown or as plain text. No client software is required: the request is an ordinary URL.

This step-by-step article describes how to request a conversion with a URL, and lists the parameters that the conversion service accepts.

Try it

Address of the page:

More information

URL to Text Kit: convert a web page to text with a URL. No key, no sign-up.

Put the address after the slash, or in url=. The answer is the page as
Markdown:

    https://www.urltotextkit.com/convert/https://example.com/some/article
    https://www.urltotextkit.com/convert?url=https://example.com/some/article

From a shell:

    curl https://www.urltotextkit.com/convert/https://example.com/some/article
    curl -G https://www.urltotextkit.com/convert \
        --data-urlencode 'url=https://example.com/page?a=1&b=2'

Other formats: text without the marks,
cleaned-up HTML, or JSON with the title, the final address, the status
and the content:

    https://www.urltotextkit.com/convert?format=text&url=https://example.com/
    https://www.urltotextkit.com/convert?format=html&url=https://example.com/
    https://www.urltotextkit.com/convert?format=json&url=https://example.com/
    curl -H 'Accept: application/json' \
        https://www.urltotextkit.com/convert/https://example.com/

Put url last, or percent-encode it: an address written out as it is
runs to the end of the line, with its own ? and & in it.

Redirects are followed and X-Source-Url says where the page came from.
Images are left out; images=1 keeps them as links. A long page is cut
at 400 kB and X-Incomplete says so. HTML, plain text, Markdown, JSON and
XML are read; PDFs and other files are not.

NOTE: The conversion service does not run scripts. Text that a page writes with a script is not included in the result.

Applies to

  • URL to Text Kit 2.0
  • URL to Text Kit 1.5 Standard Edition
  • URL to Text Kit Server Component

Keywords: kbhowto kbhowtomaster kburl KB100417

Article Translations
English (US)
Related Articles
Q100389 PRB: Result Is Empty for Pages That Use Frames
Q100402 INFO: Supported Character Sets
Q100420 HOW TO: Install the Server Component
Was this article helpful?
Yes No
Feedback is temporarily unavailable.