Data Engineering

Apache Airflow Data Engineering

Open guide: Apache Airflow

7 direct recorded connections in this view.

• Dependency / dependsOnApache Airflow lists Linux as a dependency.
• Complements / complementsApache Airflow lists Apache Kafka as a complement.
• Complements / complementsApache Airflow lists PostgreSQL as a complement.
• Complements / complementsApache Airflow lists Apache Spark as a complement.
• Complements / complementsApache Kafka lists Apache Airflow as a complement.
• Complements / complementsApache Spark lists Apache Airflow as a complement.
• Recorded use / usedByLinux records Apache Airflow in its usedBy list. This is a recorded use association, not an inferred dependency.

Apache Iceberg Data Engineering

Open guide: Apache Iceberg

3 direct recorded connections in this view.

• Complements / complementsApache Iceberg lists Snowflake as a complement.
• Complements / complementsApache Iceberg lists Apache Spark as a complement.
• Complements / complementsApache Spark lists Apache Iceberg as a complement.

Apache Kafka Data Engineering

Open guide: Apache Kafka

9 direct recorded connections in this view.

• Complements / complementsApache Airflow lists Apache Kafka as a complement.
• Dependency / dependsOnApache Kafka lists Linux as a dependency.
• Recorded use / usedByApache Kafka records Debezium in its usedBy list. This is a recorded use association, not an inferred dependency.
• Recorded use / usedByApache Kafka records Confluent Schema Registry in its usedBy list. This is a recorded use association, not an inferred dependency.
• Complements / complementsApache Kafka lists Apache Airflow as a complement.
• Complements / complementsApache Spark lists Apache Kafka as a complement.
• Dependency / dependsOnConfluent Schema Registry lists Apache Kafka as a dependency.
• Dependency / dependsOnDebezium lists Apache Kafka as a dependency.
• Recorded use / usedByLinux records Apache Kafka in its usedBy list. This is a recorded use association, not an inferred dependency.

Apache Spark Data Engineering

Open guide: Apache Spark

7 direct recorded connections in this view.

• Complements / complementsApache Airflow lists Apache Spark as a complement.
• Complements / complementsApache Iceberg lists Apache Spark as a complement.
• Dependency / dependsOnApache Spark lists Linux as a dependency.
• Complements / complementsApache Spark lists Apache Kafka as a complement.
• Complements / complementsApache Spark lists Apache Iceberg as a complement.
• Complements / complementsApache Spark lists Apache Airflow as a complement.
• Recorded use / usedByLinux records Apache Spark in its usedBy list. This is a recorded use association, not an inferred dependency.

Confluent Schema Registry Data Engineering

Open guide: Confluent Schema Registry

2 direct recorded connections in this view.

• Recorded use / usedByApache Kafka records Confluent Schema Registry in its usedBy list. This is a recorded use association, not an inferred dependency.
• Dependency / dependsOnConfluent Schema Registry lists Apache Kafka as a dependency.

Debezium Data Engineering

Open guide: Debezium

6 direct recorded connections in this view.

• Recorded use / usedByApache Kafka records Debezium in its usedBy list. This is a recorded use association, not an inferred dependency.
• Dependency / dependsOnDebezium lists Apache Kafka as a dependency.
• Dependency / dependsOnDebezium lists PostgreSQL as a dependency.
• Dependency / dependsOnDebezium lists MySQL as a dependency.
• Recorded use / usedByMySQL records Debezium in its usedBy list. This is a recorded use association, not an inferred dependency.
• Recorded use / usedByPostgreSQL records Debezium in its usedBy list. This is a recorded use association, not an inferred dependency.

dbt Data Engineering

Open guide: dbt

4 direct recorded connections in this view.

• Complements / complementsdbt lists Snowflake as a complement.
• Complements / complementsdbt lists PostgreSQL as a complement.
• Complements / complementsPostgreSQL lists dbt as a complement.
• Complements / complementsSnowflake lists dbt as a complement.

MySQL Database

Open guide: MySQL

2 direct recorded connections in this view. 4 further records touch entries outside this view.

• Dependency / dependsOnDebezium lists MySQL as a dependency.
• Recorded use / usedByMySQL records Debezium in its usedBy list. This is a recorded use association, not an inferred dependency.

PostgreSQL Database

Open guide: PostgreSQL

5 direct recorded connections in this view. 30 further records touch entries outside this view.

• Complements / complementsApache Airflow lists PostgreSQL as a complement.
• Complements / complementsdbt lists PostgreSQL as a complement.
• Dependency / dependsOnDebezium lists PostgreSQL as a dependency.
• Recorded use / usedByPostgreSQL records Debezium in its usedBy list. This is a recorded use association, not an inferred dependency.
• Complements / complementsPostgreSQL lists dbt as a complement.

Snowflake Database

Open guide: Snowflake

3 direct recorded connections in this view.

• Complements / complementsApache Iceberg lists Snowflake as a complement.
• Complements / complementsdbt lists Snowflake as a complement.
• Complements / complementsSnowflake lists dbt as a complement.

Linux Systems

Open guide: Linux

6 direct recorded connections in this view. 31 further records touch entries outside this view.

• Dependency / dependsOnApache Airflow lists Linux as a dependency.
• Dependency / dependsOnApache Kafka lists Linux as a dependency.
• Dependency / dependsOnApache Spark lists Linux as a dependency.
• Recorded use / usedByLinux records Apache Kafka in its usedBy list. This is a recorded use association, not an inferred dependency.
• Recorded use / usedByLinux records Apache Airflow in its usedBy list. This is a recorded use association, not an inferred dependency.
• Recorded use / usedByLinux records Apache Spark in its usedBy list. This is a recorded use association, not an inferred dependency.