Dwight is a well-rounded, passionate software engineer with 25+ years of experience developing business software using industry-standard patterns, best practices, and advanced programming techniques. He has extensive experience with all aspects of the software development life cycle including requirements definition, architecture, design, development, testing, and deployment. His most recent project focused on Big Data building Spark pipelines on Databricks and AWS. He has a great balance of technical, analytical, problem-solving, communication, and people-oriented skills.Hire Dwight
Researched and recommend SAAS BI tool used for internal analytics and embedded in product offering- Investigated NLP transformations with John Snow Labs – Created pipeline to automate RedCap cloud data extraction that introduced significant time savings, improved data accuracy, and also enabled additional quality assurance possibilities. – Researched and recommend SAAS BI tool used for internal analytics and embedded in product offering
Skills: Docker · DBT · Natural Language Processing (NLP) · Amazon Web Services (AWS) · Python (Programming Language) · Snowflake · Apache Spark · SQL · Databricks· RedCap · SAAS BI Tools · GCP · ETL
Worked with data at scale using Spark. Migrated as team resident Data Engineer in Data Science team
Skills: Amazon Elastic MapReduce (EMR) · Terraform · Apache Airflow · AWS Glue · Amazon Athena · Databricks · AWS SageMaker · Docker · Amazon Web Services (AWS) · Python (Programming Language) · Scala · Apache Spark · PySpark · ETL · S3
Conducted advanced performance analysis of client’s enterprise software using advanced statistical techniques to assess software’s cloud readiness. Led engineer responsible for developing big-data platform on data bricks AWS utilizing Scala and Spark. Also, lead efforts to connect client sites using KafkaConnect and Debezium Docker containers. Lead .NET client engineer responsible for developing high-performance on-premise data transfer middleware that utilizes Kafka to send messages to AWS to be consumed by Spark streaming application hosted on Databricks. Conduct advanced performance analysis of client’s enterprise software using advanced statistical techniques to assess software’s cloud readiness.
Skills: Data Bricks · Apache Kafka · Apache Spark Streaming · Debezium · .NET Framework · Statistical Data Analysis · Docker · Amazon Web Services (AWS) · C# · Scala · Apache Spark · Microsoft SQL Server
Sole developer responsible for designing and developing a complex WPF desktop application for editing and maintaining Microsoft Analysis Server cube databases to replace the native Visual Studio editor.