My DE Learning Logs
search
⌘Ctrlk
My DE Learning Logs
  • user-ninjaMy Data Engineering Learnings
  • Additional learning resources
  • Database Systems
    • Sources
    • Database Systems
    • Lectures by CMU Database Group
    • Types of databases
    • Maintaining a database
    • Database connectors and drivers
    • Types of storage
  • SQL
    • DQL vs DDL vs DML vs DCL vs TCL
    • SQL concepts
    • Working with JSON data
    • Working with geospatial data
    • SQL flavors (dialects)
  • Data Storage Formats and Data Compaction
    • Types of data and their formats
    • What does zero-copy mean?
    • Data Compaction
    • Apache Parquet
    • Apache Arrow and Pyarrow
  • Bash
    • Commands and Scripting
    • Cron jobs
  • Data Modeling
    • Conceptual, Logical, and Physical Data Modeling
    • Types of table relationships
    • Data Normalization
    • Inmon
    • Kimball / Dimensional Data Modeling
    • Data Vault 2.0
    • One Big Table (OBT)
    • OLAP/Data cube
  • Batch processing
    • Batch architectures
    • Apache Spark
    • Apache Beam - both batch and stream processing unified
  • stream processing
    • Content from the book "Streaming Systems"
    • Spark Structured Streaming
    • Apache Flink
    • Kafka Streams
    • Handling System Overload: Backpressure and DLQs.
    • Are workflow orchestrators used with streaming?
  • Data Strategy
    • Data Strategy Concepts Overview
    • Data Quality
    • Data Contracts
    • Data Ingestion and Data Integration
    • Data Architecture
    • Data Transformation
    • Data Security
    • Data Mesh
    • Data Maturity
    • Schema-on-Read and Schema-on-Write
    • Data Idempotency
    • Migrations
    • Data Lifecycle & Architectural Patterns
  • Open-source OLAP systems
    • Clickhouse
    • Apache Pinot
    • Apache Druid
    • DuckDB
    • Apache StarRocks
    • chDB
  • Open Table Formats
    • What are Data Lakehouse and table formats?
    • Apache Iceberg
    • Apache Hudi
    • Apache Paimon
    • DuckLake
  • Event-Streaming / Message Brokers
    • Message and Event driven systems
    • Apache Kafka
    • RabbitMQ
    • Redpanda
    • NATS
  • DE design patterns
    • MDM Entity resolution patterns
    • Design patterns
    • Update patterns
    • Change Data Capture
    • FDW (read replicas)
    • Backfilling
    • Replication vs Loading
  • Networking
    • Networking Fundamentals
  • Version control
    • Git
  • DataOps: IaC, CI/CD, Workflow orchestration
    • DataOps
    • What is IaC?
    • Why is CI/CD important?
    • Workflow orchestration
  • Cloud Platforms
    • What is cloud computing?
    • AWS
    • GCP
    • Cloud Service Equivalents: AWS, GCP, and Azure
    • Snowflake
    • Storage
    • Considerations for choosing infrastructure location
  • Container Orchestration
    • Docker, Docker Compose, and Docker Swarm
    • Microservices fundamentals
    • Kubernetes and Helm
    • Podman
  • Programming paradigms
    • Overview of programming paradigms
    • Object-oriented vs Functional programming
    • Concurrent programming
    • Flow-based programming
  • Programming languages
    • Python
    • Golang
  • Testing for programming and DE
    • Types of testing
    • Python
    • Golang
  • Serving Data
    • General considerations
    • Types of Analytics
    • Serving for Analytics and ML
    • What you should know about Machine Learning as a DE
    • MLOps
    • Open-Source BI Tools
  • Make
    • Make and Makefiles
  • YAML
    • YAML
  • Jinja templating
    • Cheatsheet
  • Cost Optimization and Business Value
    • FinOps, TCO, TOCO
  • Security and Privacy in DE
    • Best practices for Security and Privacy in DE
  • Thinking like a Data Engineer
    • Business responsibilities of a Data Engineer
    • Whom you'll work with (stakeholders)
    • Requirements gathering
    • Framework for thinking like a data engineer
    • Business Metrics and Terminology
    • What is Analytics Engineering?
  • Various topics
    • Glossary of terms
  • MCP protocol
    • Page 1
  • Linux OS
    • Untitled
gitbookPowered by GitBook
block-quoteOn this pagechevron-down
  1. Testing for programming and DE

Golang


go test command how it works


hashtag
Unit tests


hashtag
Integration tests


This talk applies to testing in Golang, but it's probably valid for any programming languagearrow-up-right


PreviousPythonchevron-leftNextGeneral considerationschevron-right

Last updated 2 months ago

  • Unit tests
  • Integration tests