data.md

!meta title="Data science, lean databases and formats"

Basic

• Ontologies and how to deal with lists.
• Standards: schema.org, microdata, microformats, json, yaml, csv, dot, vcard.
• Intelligence: how to easilly search, index and produce outputs with strutured data?
• Samples: TODO and ChangeLog (see yankee: Changelogs meet YAML).

Software

• mtail.
• Scrapy | A Fast and Powerful Scraping and Web Crawling Framework.
• phantomjs in stretch.
• wpull.
• Darktable - virtual lighttable and darkroom for photographers.
• OsmAnd and GPX tracks.

API, bigdata, etc

• https://stripe.com/blog/idempotency
• https://botman.io
• https://github.com/metabase/metabase
• Apache Drill, presto, hadoop, etc.
• Redash.
• TensorFlow.
• Wikidata.
• Swagger Specification.

Datasets

• API de respostas instantâneas do DuckDuckGo (example).
• Search APIs | ProgrammableWeb.
• Have I been pwned? API v2.