All Stories

How to index data in Redshift

How to create an equivalent of an index in Redshift
Bartosz Mikulski
15 Dec 2020

How to generate a sequence of dates in Redshift

How to use the generate_series function to generate a sequence of dates
Bartosz Mikulski
14 Dec 2020

How to assign rows to ranked groups in AWS Athena

How to use the NTILE function in Athena
Bartosz Mikulski
13 Dec 2020

How to define an AWS Athena view using Airflow

How to use the AWSAthenaOperator
Bartosz Mikulski
12 Dec 2020

How to write Hive queries with column position number in the GROUP BY or ORDER BY clauses

How to enable column position support in Hive GROUP BY or ORDER BY
Bartosz Mikulski
11 Dec 2020

How to check whether a regular expression matches a string in Hive

What is the equivalent of Athena/Presto regexp_like in Hive
Bartosz Mikulski
10 Dec 2020

How to check whether a YARN application has finished

How to use Airflow PythonSensor to check whether a YARN application finished running

Bartosz Mikulski
09 Dec 2020

How to use WHEN CASE queires in AWS Athena

Using conditions in AWS Athena queries
Bartosz Mikulski
08 Dec 2020

How to decode base64 to text in AWS Athena

How to use from_base64 in AWS Athena
Bartosz Mikulski
07 Dec 2020

How to combine two DataFrames with no common columns in Apache Spark

Use full outer join to combine two Apache Spark DataFrames with no common columns
Bartosz Mikulski
06 Dec 2020

How to get names of columns with missing values in PySpark

How to get the names of missing properties for every row in a PySpark Dataframe
Bartosz Mikulski
05 Dec 2020

How to set a different retry delay for every task in an Airflow DAG

How to use a different retry delay in every Airflow task
Bartosz Mikulski
04 Dec 2020
About me | Newsletter