mikulskibartosz.name
Career Coaching for Data Professionals
Speaker
Newsletter
Bartosz Mikulski
Building trustworthy data pipelines because AI cannot learn from dirty data
Featured
PySpark-Check - data quality validation for PySpark 3.0.0
Last week, I was testing whether we can use AWS Deequ for data quality validation. I ran into a few problems. First of all, it...
The problem with software testing in data engineering
What if we found a bug in our data pipelines? What if that bug were easy to fix, but it would require a lot of...
Data flow - what functional programming and Unix philosophy can teach us about data streaming
What does stream processing have in common with functional programming and Unix?
Four books to boost your programmer career
I quit my dream job because of a book
All Stories
Data versioning with LakeFS
Why you should use LakeFS to build a data lake that supports data versioning
How to add custom preprocessing code to a Sagemaker Endpoint running a Tensorflow model
How to customize input/output of a Sagemaker Endpoint running a Tensorflow model
How to A/B test Tensorflow models using Sagemaker Endpoints
How to deploy multiple model versions as one Sagemaker Endpoint
How to predict the value of time series using Tensorflow and RNN
How to train the RNN model in Tensorflow to predict time series?
How to deploy a REST API AWS Lambda using Chalice and AWS Code Pipeline
How to create a REST API Endpoint using AWS Lambda, Chalice, and AWS Code Pipeline
How to deploy a Tensorflow model using Sagemaker Endpoints and AWS Code Pipeline
How to build a Docker image using AWS Code Pipeline and deploy it as an Sagemaker Endpoint
How to deal with days of the week in machine learning
How to encode week days as features for machine learning models
On technical blogging
How to start blogging as a programmer
Why do we use dropout in artificial neural networks?
How does dropout work in artificial neural networks?
How to measure Spark performance and gather metrics about written data
How to track Spark metrics in AWS CloudWatch
How to use AWS Batch to run a Python script
How to build a Docker image, define an AWS Batch job using Terraform, and run the AWS Batch job using Airflow
Anomaly detection in Airflow DAG using Prophet library
How to detect problems in Airflow pipeline using Prophet for time series anomaly detection
« Prev
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
Next »