tra-extract-text#

Extract text from web pages using the trafilatura command-line tool.

Installation#

bash

pip install trafilatura

Usage#

Basic text extraction (Markdown)#

bash

trafilatura -u URL --markdown

Extract raw text (no formatting)#

bash

trafilatura -u URL --text

Output to file#

bash

trafilatura -u URL --markdown > output.md
trafilatura -u URL --text > output.txt

CLI Options#

OptionDescription-u, --urlTarget URL (required)--markdownOutput as Markdown (default)--textOutput as plain text--htmlOutput as HTML--jsonOutput as JSON--xmlOutput as XML-o, --outputWrite to file instead of stdout--with-metadataInclude metadata (title, author, date)--licenseShow license info

Examples#

Extract a Medium article to markdown:

bash

trafilatura -u "https://medium.com/example/article" --markdown

Extract and save:

bash

trafilatura -u "https://news.example.com/article" --markdown -o article.md

Extract with metadata:

bash

trafilatura -u "https://example.com/post" --markdown --with-metadata