Links tagged “data-processing”

github.com

A Python module for web mining, bundling crawling and scraping, natural language processing, machine learning, network analysis and visualisation.

blog.gopheracademy.com

An introduction to Glow, a pure-Go map-reduce framework for standalone and distributed data processing.

thebuild.com

Why Django's ORM handles very large result sets badly, and how to use PostgreSQL server-side cursors to iterate over them instead.

openrefine.org

OpenRefine, a free desktop application for cleaning messy datasets, reconciling them against external sources and converting between formats.

outwit.com

OutWit Hub, a desktop application for Windows, macOS and Linux that finds, extracts and organises data and media from web pages.

spark.apache.org

A multi-language engine for data engineering, data science and machine learning, on one machine or a cluster.

apievangelist.com

Post on how API-driven integration platforms put ETL-style data movement within reach of non-technical users, away from heavyweight enterprise tooling.

blog.gopheracademy.com

A Go pattern that builds concurrent data pipelines from structs carrying channel fields, offered as an alternative to the plain generator pattern.

codewinds.com

Creating a Node.js transform stream using the streams2 API to manipulate textual, binary, or objectstreams. Compressing and uncompressing stream with gzip. Encrypting and decrypting data stream with aes-256. Creating sha1 digest transform stream. Create transform stream which filters sensitive information.

nicolashery.com

Nicolas Hery is a freelance web developer based in Paris, France. He has a background in applied mathematics, works as a full-stack developer mostly in JavaScript and Node.js, as well as Python for scientific computing.

lemondeinformatique.fr

« Python est si facile à apprendre que c'est un stagiaire qui enseigne le langage aux nouveaux salariés » http://t.co/ql6U4dWC