Understanding compressed matrices for sparse data

In this article, you’ll learn about how matrices representing sparse data, e.g. user ratings, can be compressed to vertically scale machine learning algorithms by fitting datasets into memory that would otherwise be too large. You’ll learn about the various compression formats and delve into their trade-offs.
Continue reading “Understanding compressed matrices for sparse data”

Securely transferring data to and from a database

This article will explore the many ways in which data can be copied to and from a database securely. Securely performing copy operations¬†is important because, in the course of data engineering and data science work, data study and model development must often be done locally. Copying data sets over compromised systems such as email and cloud storage without adequate preparation exposes businesses to security breaches such as data leaks, “man in the middle” attacks, keylogging, and backdoors.

Continue reading “Securely transferring data to and from a database”