Skills
A stack built for production GenAI.
Not a checklist of buzzwords these are the tools I reach for on real systems with real users.
Data Engineering & Pipelines
Streaming pipelines (Kafka, Spark Structured Streaming)Batch ETL / ELTApache Spark (RDD, DataFrame, Spark SQL)Apache Airflow (DAG orchestration)Apache NiFi & FlumeData lakes & lakehousesDelta Lake / ParquetSnowflake & BigQuerydbtCDC & event-driven architecturesData modeling & warehousingData quality & observabilityPetabyte-scale processing
LLM Applications
RAGHybrid retrievalRerankingEmbeddingsVector searchPrompt engineeringTool & function callingAgent workflowsConversation memoryMulti-agent orchestrationGuardrails & safetyStructured output / JSON modeStreaming responses
Evaluation & Fine-tuning
Offline & online evalsGolden-set benchmarkingFaithfulness scoringHallucination detectionRegression suitesLoRAPEFTRLHF / DPODistillationQuantization (GGUF, AWQ)Prompt A/B testingLLM-as-judge
Machine Learning & MLOps
Classical ML (XGBoost, LightGBM)Deep learningNLPComputer visionTime-series forecastingRecommender systemsFeature storesMLflowModel registry & versioningExperiment trackingModel monitoring & driftA/B testing
Languages & Frameworks
PythonJavaScalaTypeScript / JavaScriptGoSQLFastAPIFlaskSpring BootNode.jsReactPyTorchTensorFlowscikit-learnPandasNumPyLangChainLlamaIndex
Cloud & DevOps
AWSAzureGCPDockerKubernetesHelmTerraformCI/CD (GitHub Actions, Jenkins)IaCObservability (Datadog, Grafana, Prometheus)Secrets managementCost optimizationServerless (Lambda, Cloud Run)
Data Engineering & Streaming
SparkSpark Structured StreamingKafkaFlinkDelta LakeIcebergDatabricksSnowflakeBigQueryRedshiftAirflowdbtHiveTrino / PrestoETL & ELT designData modeling (dimensional, lakehouse)CDC pipelines
Backend & System Design
REST APIsGraphQLgRPCEvent-driven architectureMicroservicesDistributed systemsHigh-throughput servicesCaching (Redis)Postgres / MySQLMongoDBAuthentication & authorizationPerformance tuning
Leadership & Delivery
Technical leadershipArchitecture & design reviewsMentorshipCross-functional collaborationAgile / ScrumRoadmap planningHiring & interviewingStakeholder communication