All Stories

How to write to a SQL database using JDBC in PySpark

How to use JDBC driver in PySpark to write a DataFrame to a SQL database
Bartosz Mikulski
22 Dec 2020

How to add dependencies as jar files or Python scripts to PySpark

How to add a jar file or a Python file as a Pyspark dependency
Bartosz Mikulski
21 Dec 2020

How to reset the consumer offset in Apache Kafka topic

How to use kafka-consumer-groups.sh to reset topic offsets
Bartosz Mikulski
20 Dec 2020

How to purge a Kafka topic

How to remove all messages from a Kafka topic
Bartosz Mikulski
19 Dec 2020

Get the last day of the month in Redshift

How to use the last_day function in Redshift
Bartosz Mikulski
18 Dec 2020

How to make an unconditional join in Redshift

LEFT OUTER JOIN ON 1=1 in Redshift
Bartosz Mikulski
17 Dec 2020

How to count the number of rows that match a condition in Redshift

How to count the rows by multiple conditions at the same time in SQL
Bartosz Mikulski
16 Dec 2020

How to index data in Redshift

How to create an equivalent of an index in Redshift
Bartosz Mikulski
15 Dec 2020

How to generate a sequence of dates in Redshift

How to use the generate_series function to generate a sequence of dates
Bartosz Mikulski
14 Dec 2020

How to assign rows to ranked groups in AWS Athena

How to use the NTILE function in Athena
Bartosz Mikulski
13 Dec 2020

How to define an AWS Athena view using Airflow

How to use the AWSAthenaOperator
Bartosz Mikulski
12 Dec 2020

How to write Hive queries with column position number in the GROUP BY or ORDER BY clauses

How to enable column position support in Hive GROUP BY or ORDER BY
Bartosz Mikulski
11 Dec 2020