Big Data Engineer Resume Sample
Weldon Schmidt
59222 Yundt Falls,
Philadelphia,
PA
+1 (555) 408 5416
Work Experience
Lead Big Data Engineer
07/2017
-
PRESENT
Boston, MA
- Support, maintain, and document Hadoop and MySQL data warehouse
- Iterate and improve existing features in the pipeline as well as add new ones
- Design, develop, document, and test new requirements in the data pipeline using PERL, BASH, PIG and OOZIE in the Hadoop ecosystem
- Provide full operational support – analyze code to identify root causes of production issues and provide solutions or workarounds and lead it to resolution
- Participate in full development life cycle including requirements analysis, design, development, deployment and operations support
- Work with engineering team members to explore and create interesting solutions while sharing knowledge within the team
- Work across product teams to help solve customer-facing issues
- Demonstrable experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions
Big Data Engineer
10/2011
-
03/2017
Dallas, TX
- Plan, develop, monitor and evolve needed infrastructure in collaboration with Ops partners
- Progressive experience as a Systems/Software Engineer, Application Developer or related occupation
- Provides technical design based on business requirements
- Communicates and coordinates with cross functional teams to ensure business objectives are met
- Develops, tests and deploys software applications/systems using scientific analysis and mathematical models to predict and measure outcome and consequences of design
- Provides guidance and mentoring in technical areas to a team of Developer/Analysts
- Documents and submits status reports to leadership
- Provides guidance on new technologies/methodologies
Junior Big Data Engineer
09/2004
-
09/2011
Detroit, MI
- Designing, developing and maintaining new generation machine learning based big-data web page categorization, data/IP mining, and malicious site detection systems
- Creating and enhancing tools to analyze and process large quantity of data set
- Utilize your programming skills for efficient and robust implementation
- Work closely with malware research/data science teams to enhance malicious site detection, and machine learning/data mining based big data system
- Solve engineering problems by creating solutions that leverage existing technologies and utilize your technical prowess to design and implement solutions where none exist
- Design, build, improve and maintain a high performance and highly scalable services exposed to our solution and a broader development community
- Work with real-time data processing, messaging, streaming techniques and workflows
Education
University of Sioux Falls
1998 - 2003
Bachelor's Degree in Computer Science
Professional Skills
- Very strong skills working with very large data sets with a variety of tools; experience in dealing with performance and scaling issues
- Demonstrated excellent planning and organizational skills
- Proven design, coding, testing and debugging skills and experience
- Strong analytical, learning and problem solving skills with personal interest in subjects such as math/statistics, machine learning, AI and analytics
- Self-starting, requiring minimal supervision with strong problem-solving skills
- Relevant software development / consulting experience with strong skill on database modeling and architecture
- Strong execution skills in a fast-paced environment using agile methodologies
How to write Big Data Engineer Resume
Big Data Engineer role is responsible for technical, python, software, programming, development, business, analytical, interpersonal, coding, java.
To write great resume for big data engineer job, your resume must include:
- Your contact information
- Work experience
- Education
- Skill listing
Contact Information For Big Data Engineer Resume
The section contact information is important in your big data engineer resume. The recruiter has to be able to contact you ASAP if they like to offer you the job. This is why you need to provide your:
- First and last name
- Telephone number
Work Experience in Your Big Data Engineer Resume
The section work experience is an essential part of your big data engineer resume. It’s the one thing the recruiter really cares about and pays the most attention to.
This section, however, is not just a list of your previous big data engineer responsibilities. It's meant to present you as a wholesome candidate by showcasing your relevant accomplishments and should be tailored specifically to the particular big data engineer position you're applying to.
The work experience section should be the detailed summary of your latest 3 or 4 positions.
Representative Big Data Engineer resume experience can include:
- Demonstrated ability to manage multiple projects and strong analytical skills
- Demonstrated experience with object oriented design, coding and testing patterns as well as experience in engineering software platforms and large-scale data
- Excellent Programming skills at a higher level of abstraction using Scala and Spark
- Strong Java programing skills
- Solid system design, problem solving and data analysis skills
- Excellent research, problem-solving, communication, presentation, collaboration, and documentation skills
Education on a Big Data Engineer Resume
Make sure to make education a priority on your big data engineer resume. If you’ve been working for a few years and have a few solid positions to show, put your education after your big data engineer experience. For example, if you have a Ph.D in Neuroscience and a Master's in the same sphere, just list your Ph.D. Besides the doctorate, Master’s degrees go next, followed by Bachelor’s and finally, Associate’s degree.
Additional details to include:
- School you graduated from
- Major/ minor
- Year of graduation
- Location of school
These are the four additional pieces of information you should mention when listing your education on your resume.
Professional Skills in Big Data Engineer Resume
When listing skills on your big data engineer resume, remember always to be honest about your level of ability. Include the Skills section after experience.
Present the most important skills in your resume, there's a list of typical big data engineer skills:
- Effective oral and written communication with strong analytical, problem solving, multitasking and project management skills are essential on the job
- Good data visualisation skills including proven usage of PowerBI or Tableau
- Experience with effectively modeling and storing data in HDFS and using sqoop to import/export data out of HDFS
- Strong team-working skills, working in global teams across multiple time zones
- Good Data Analysis and troubleshooting skills with eye towards producing quality data products
- Good debugging, critical thinking, and communication skills
List of Typical Experience For a Big Data Engineer Resume
1
Experience For Big Data Engineer Resume
- Very strong software development skills
- Ensuring the effective development of robust, effective applications, or application changes, as defined by the BS project
- Experience with Big Data platforms and tools and Hadoop implementation experience including the following
- Uses advanced programming skills in Scala, Java or any of the major languages to build robust data pipelines and dynamic systems
- Participate in continuing education programs to grow your skills both technically and in the Williams-Sonoma business domain
2
Experience For Lead Big Data Engineer Resume
- Strong object oriented programming experience in Java, Scala, Python or similar
- Solid experience in at least one business intelligence reporting tool
- Use your expert coding skills across a number of languages from Python, Java and PHP
- Demonstrated hands-on experience with at-least one of the major Hadoop distributions (Preferrably Cloudera)
- Experience or strong desire to work on Big Data technologies such as Hadoop, Pig Latin, Hive, Druid and Storm
3
Experience For Principal Big Data Engineer Resume
- Strong experience in RDBMs/NoSQL databases
- Your strong technical design and analysis skill
- Exert technical influence over multiple teams, increasing their productivity and effectiveness by sharing deep knowledge and experience
- Strong technical credentials, with at least 10 years of overall software development experience particularly in NoSQL/BigData space
- This person shall have the skills to be able to work alone as well in a team environment
- Strong experience working with Hadoop/Big Data technologies; i.e Hadoop, MapR, No-SQL Database capability
4
Experience For Junior Big Data Engineer Resume
- Strong analytical capabilities, data processing development background and multiple DBMS experience
- Streaming Analytics and Real Time processing experience such as Spark Streaming, Storm is desirable
- Understanding or even practical experience of handling and manipulating semi-structured and unstructured data
- Developing new or enhancing prior data acquisition and ETL pipelines from various sources into big data ecosystem
- Understanding of and experience with machine learning concepts desired
- Crafting efficient and robust Hadoop solutions for performance improvement and end-user experiences
- Working experience with Hive, Pig, MapReduce, Hbase, Elastic, Spark
- Understanding of the SOLID object-oriented principles
5
Experience For Think Big Data Engineer Resume
- Working experience with Cloud development stacks like OpenStack, CloudStack, VCloud, AWS, EC2 for Hybrid Configurations and Managed Cloud Considerations
- Working experience with various NoSQL databases such as Cassandra, HBase, MongoDB, and/or Couchbase
- Working experience with various time-series databases such as OpenTSDB and Apache Druid
- Experienceworking within an agile framework
- Hadoop: Experience with storing, joining, filtering, and analyzing data using Spark, Hive and Map Reduce
- Established experience of designing and building analytical data warehouses including using ETL and other data wrangling tools
- Demonstrate best practices for unit testing, CI/CD, performance testing, capacity planning, documentation, monitoring, alerting, and incident response
6
Experience For MTS, Big Data Engineer Resume
- Experience in designing and developing data processing pipelines using distributed computing technologies such as Hive, Spark, and etc
- Experience in data profiling, complex sampling, statistical testing, and performing test of reliability on enterprise data
- Experience in building stream-processing systems, using solutions such as Kafka, Storm or Spark-Streaming
- Experience building stream-processing systems, using technologies such as Kafka, Storm and Spark-Streaming
- Good understanding of working in a DevOps style of workplace including working within the Atlassian set of tools (Bitbucket, Jira, Confluence)
7
Experience For Platform / Big Data Engineer Resume
- Experience building systems to perform real-time data processing using Spark Streaming and Kafka, or similar technologies
- Experience in installation, configuration, upgrading, supporting and managing Hadoop Clusters using Cloudera distributions
- Working in Information Technology including experience with UNIX operating systems and basic networking concepts
- Evidence of Data Processing at Scale – designing, developing and continually improving tools
- Experience creating data pipelines including ETL/ELT, streaming, and SQL tuning
- Experience working with continuous integration framework, building regression-able code within data world using GitHub, Jenkins and related applications
8
Experience For CFS QR Big Data Engineer Resume
- Experience standing up and deploying solutions on top of the following AWS technologies: EMR, EC2, S3, Redshift, Dynamo, Kinesis
- Experience in cluster designing and deployment, troubleshooting and tuning
- Experience building, deploying and managing scalable Elasticsearch platforms and applications
- Strong knowledge of designing and development of distributed systems software on large datasets for machine learning, data mining and analytics
- Experience in evolving/managing technologies/tools in a rapidly changing environment to support business needs and capabilities
- Experience with Configuring, optimizing & supporting Hadoop platform
- Solid understanding of Big Data approaches in batch processing or stream processing
9
Experience For iXp Intern, Big Data Engineer Resume
- Scala -experience to help with troubleshooting/debugging production Spark issues and improving performance where necessary
- Experience with building and or using state of the art methods for scaling machine learnt predictive models
- Hands-on experience applying Big Data technologies, including Spark and Hadoop distributed-computing platforms, to real-world problems
- Software programming life cycle experience – Analysis, Design, Coding, Integration, Testing
- Experience with building operations research/machine learning algorithms, and productionizing them at scale in a distributed computation environment
- Experience working with data processing, loading and transformation systems (e.g. MapReduce, Spark, Dataflow)
- Experience on distributed computing and on solving complex cluster computing problems
- Experience in cloud and distributed systems principles, including load balancing, networks, scaling, in-memory vs. disk, etc.is required
10
Experience For OCT Big Data Engineer Resume
- Experience in designing, building and managing applications to process large amounts of data in a Hadoop ecosystem
- Experience in designing, building, and using a big data distribution, preferably Cloudera (Hortonworks, or MapR), for
- Experience in developing distributed computing systems applications using Hadoop
- Working with Hadoop clusters including hands-on experience working with HDFS, YARN, Spark, Hive, Kafka, Spark, Zookeeper, HBASE and Kerberos
- Proven record of researching, evaluating and utilizing latest technologies/tools/frameworks around AWS/Hadoop eco system
- Experience with building stream-processing systems, using solutions such as Striim and Kudu
- Hands on experience in Importing and exporting data from different databases like SQL, Oracle, Teradata into HDFS using Sqoop
List of Typical Skills For a Big Data Engineer Resume
1
Skills For Big Data Engineer Resume
- Team player with excellent interpersonal skills and the ability to work in an exciting environment
- Excellent teamworking and interpersonal skills
- Excellent logical, analytical, and creative problem-solving skills
- Able to effectively communicate highly technical information to numerous audiences, including management, the user community, and less-experienced staff
- Excellent verbal and written communication skills as well as the ability to bridge gaps between data science and business management
- Excellent communication, interpersonal, and decision making skills
- Strong Linux skills and RDBMS/ETL knowledge
- Demonstrated leadership skills and self-direction
- Excellent programming skills in either Java, Scala or Python
2
Skills For Lead Big Data Engineer Resume
- Experience as a data or software engineer in an analytics or data warehouse team with Unix programming skills
- Effective communication skills in an environment that is biased towards building useable code over SDLC documentation
- Excellent communication skills with ability to work well cross-functionally across teams
- Excellent time management, communication, presentation, and organizational skills
- Strong experience on Database technologies, Data Warehouse, Data Validation & Certification, Data Quality, Metadata Management and Data Governance
- Strong interpersonal and communication skills, written and oral, to allow works well in a multicultural team environment
- Versatile data collection, curation, preparation and transformation skills/experience for diverse needs
- Strong database development skills in Store procedure, Query language, performance optimization in RDBMS (DB2) as well as Cassandra and Hadoop
- Demonstrated ability to continuously learn new skills and technologies
3
Skills For Principal Big Data Engineer Resume
- Proven analytic skills related to working with unstructured datasets
- Goal oriented, motivated self-starter, with excellent organizational and multi-tasking skills
- Strong interpersonal skills and initiative
- Excellent problem-solving and interpersonal communication skills
- Developing and maintaining strong relationships across BCUS organisation ensuring effective delivery of applications into the production environment
- Willing to put energy in learning new technologies and skills
- Understanding of software skills such as business analysis, development, maintenance and software improvements
- Programming skills in other open source tools such NIFI and Streamline
- Programming skills in Java / Python / Scala
4
Skills For Junior Big Data Engineer Resume
- Programming skills: Java, SCALA, Python
- Experience designing, developing, testing and continually improving tools which deliver scalable and effective data infrastructure systems
- Solid understanding of data access and manipulation patterns, hands-on experience using Big Data Processing technologies such as Spark
- Experience working with ETL in multi-terabyte data warehouses. Experience in dealing with performance and scaling issues
- Extensive experience in Big Data Ecosystem technologies with hands on experience implementing data ingestion, storage, processing and publication solutions
- Demonstrated experience leveraging data mining techniques to process large scale data and assemble complex, high quality datasets
- Deep experience doing data analyses against relational databases and a good understanding of relational database management concepts
5
Skills For Think Big Data Engineer Resume
- Your strategic thinking and critical problem solving skills
- Proven experience working with SAS and SAS programming language
- Experience in Data Warehousing, Data Marts, Data Modeling and experience in ETL tools such as Talend or Informatica or Ab Initio
- Experience coding in Python or Java, with solid CS fundamentals including data structure and algorithm design
- Programming skills in Java or Python or Scala or other scripting language etc
6
Skills For MTS, Big Data Engineer Resume
- Previous experience in creating big data or analytics solutions (Engineering, solution and design experience)
- Experience and solid understanding of Bigdata ecosystems such as Hadoop, Spark, Streaming, Kafka
- Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), data warehouse or database architecture
- Proven experience working within environments with a diverse data landscape
- Strong working experience with ETL tools like Ab Initio, SSIS, Talend or Pentaho
- Strong development experience in the common languages for data engineering (Java, Scala, Python)
- Proven experience in owning technical design and implementation
7
Skills For Platform / Big Data Engineer Resume
- Proven experience in working with Product Managers
- Solid experience solving application performance and scalability issues
- Interact with Senior Management -- can effectively interface at many levels, including top executives
- Proven experience working with UNIX/LINUX to process large data sets
- Strong software development experience in Scala and Python programing languages; other functional languages desirable
8
Skills For CFS QR Big Data Engineer Resume
- Implementation skills such as in Java, Python, and scripting in Linux environment
- Demonstrated experience in the development of an overall design, development and implementation of SQL scripts, stored procedures, cursors and triggers
- Experience in End-to-End Big data solutions and data pipline design, experience with tools of the trade: Hadoop, Hive, Pig, SPARK, Impala
- Hands-on coding skills in languages like: Java, Scala, Python
- Experience with Cloud services in AWS or Azure Experience with Hortonworks implementation
- Strong experience in external Cloud technologies (AWS, Google or Azure)
9
Skills For iXp Intern, Big Data Engineer Resume
- Your Big Data Skills with popular stacks like Hadoop and Spark
- Experience with NoSQL databases, such as HBase, Cassandra, experience with Spark
- Some software development skills
- Proven experience (2 years) with distributed systems, e.g. Mesos, Kubernetes, Spark, Hadoop, distributed databases, grid computing
- Prior work/research experience with unstructured data and data modeling
- Proven experience modeling large datasets in distributed databases such as Apache Cassandra
10
Skills For OCT Big Data Engineer Resume
- Demonstrated Hadoop experience
- Results oriented, solid work ethic with excellent attention to detail and quality
- Very strong server-side Java or .NET experience, especially in an open source, data-intensive, distributed environments
- Leverage strategic and analytical skills to understand and solve customer and business centric questions
- Java (6+) years of solid development experience w/continuous integration tools and GIT
- Fluency in English and great communication skills and ability to concisely and to-the-point deliver recommendations & proposals
- Proven experience on Big Data tools such as, Spark, Hive, Impala, Polybase, Phoenix, Presto, Kylin, etc
- Quickly learn, adapt, and implement Open Source technologies and desire to learn new skills and techniques
List of Typical Responsibilities For a Big Data Engineer Resume
1
Responsibilities For Big Data Engineer Resume
- Experience or equivalent skills & ability
- Strong co-ordination and project management skills to handle complex projects
- Demonstrated experience in designing sustainable software products, continuous build and rigorous testing, etc
- Strong experience in designing efficient and robust ETL/ELT workflows and schedulers
- Expert level experience with Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn); desirable experience with Cloudera distribution
- Creative problem-solving and analysis skills
2
Responsibilities For Lead Big Data Engineer Resume
- Proven experience as a BI / Big Data Developer
- Demonstrated experience and ability to deliver results on multiple projects in a fast-paced, agile environment
- Clear and succinct verbal and written communication skills in English and preferably also German
- Strong knowledge and hands-on experience with Java
- Big Data Application Development specific skills: SQOOP, Spark, Hive, SQL, Python
- Java/Python development skills
- Demonstrate substantial depth of knowledge and experience in a specific area of Big Data
- Collaborative interpersonal skills and ability to work within cross-functional teams
3
Responsibilities For Principal Big Data Engineer Resume
- Strong operational experience with AWS, container approaches..
- Strong experience with Apache Spark 2.0
- Expert level knowledge of JVM and OOP - previous experience in Java would be good
- Architecting, Designing, Building and supporting mission critical applications to provide the best customer experience
- Understanding of testing approaches and how to design a unit test plan to validate code or applications built
- Building and supporting robust, mission critical applications that provide the best customer experience
- Working Experience with continuous integration and continuous delivery tools like git, bamboo
- Coding experience with Python, Scala, and/or PySpark is required
4
Responsibilities For Junior Big Data Engineer Resume
- Mitigates risk by following established procedures and monitoring controls, spotting key errors and demonstrating strong ethical behavior
- Experience with building, testing & deploying tools in Development & Production
- Good understanding of real-time streaming technologies such as Apache Kafka, Azure EventHub, Spark Streaming, Apache Storm, Apache Flink etc
- Your Data Mining techniques and tooling know-how are impressive. Same goes for your experience with cloud computing
- Experience working in a data intensive role including the extraction of data (db/web/api/etc.), transformation and loading (ETL)
5
Responsibilities For Think Big Data Engineer Resume
- ETL/BI solutions using Microsoft SSIS, Informatica or having DB programming experience (TSQL, PLSQL)
- Experience dealing with unstructured data formats while ingesting in to the platform and exposing for consumption purposes
- Strong passion for delivering high performing products
- Experience with indexing, searching, and analytics over large data sets in the Elasticsearch platform
- Experience in Installing and Configuring Cloudera
- Experience with deploying applications & tools on AWS & administration of tools (Managing Users, groups & Permissions, IAM roles)
6
Responsibilities For MTS, Big Data Engineer Resume
- Experience with building monitoring around tools availability, usage & performance
- Experience with writing & optimizing Hive & Spark queries and process
- Experience working with automation tooling
- Ensure data integrity using standard rules, procedures, testing and validation
- Experience in securing Hadoop clusters connecting to multiple AD domains
- Experience with developing in and administering Hadoop cluster and Cloudera/Hortonworks stack
7
Responsibilities For Platform / Big Data Engineer Resume
- Experience in working on large dataset (in TB) using Hadoop, Spark, ElasticSearch to solve real business problems
- Hands on experience in building and deployment of Statistical Models/Machine Learning solutions
- Experience in fields encompassing Distributed computing, Big Data Analytics, Data Transformation
- Fundamental understanding of RDBMS and extensive experience using ETL tools
- Core experience in Java / Scala / Python – for data processing, other scripting languages optional
- Experience developing with modern JDK (v1.7+), Spring Projects
- Experience eliciting and documenting use cases
- Experience working with large data sets and extracting from structured or unstructured datasets
- Experience with crafting and managing data pipelines
8
Responsibilities For CFS QR Big Data Engineer Resume
- Salary starting from 2.200 EUR gross/month, depending on relevant experience
- Several years practical, in-depth experience in implementing production-grade big data solution using Hadoop, Spark, Kafka and NoSQL databases
- Experience in data modelling, design patterns, building highly scalable and secured solutions
- Experience designing REST APIs and developing RESTful Web Services
- Experience (at least familiarity) with data warehousing, dimensional modeling and ETL development
- Strong knowledge of programming languages/tools including Java, Scala, Python, Akka, Spark, SQL, Hive, and Elasticsearch
- Experience with streaming technologies such as Spark streaming, Flink, or Apache Beam
- Experience with data streaming using Kafka
- Working experience in application development and data processing
9
Responsibilities For iXp Intern, Big Data Engineer Resume
- Experience in Python scripting for automating tests and processes
- Experience building and traversing graphs
- Experience with programming/scripting languages such as Scala/Java/Python/R etc. (any combination)
- Experience creating and driving large scale ETL pipelines
- Experience with stream processing, e.g. Kafka, Spark Streaming, Akka, Flink, etc
- Hands-on experience in managing infrastructure with one or more of the following big data technologies
- Experience working in an Agile environment using TDD and Continuous Integration
10
Responsibilities For OCT Big Data Engineer Resume
- Experience with multiple threading development and advanced performance tuning
- Experience in understanding the source data from various platforms and mapping them into data models for integration and analytical needs
- Experience with large scale production databases evidencing delivery data processing solutions
- Strong understanding of OO and functional programming (preferably in Java/Scala)
- Experience with writing optimized (for memory and process time) spark jobs to process streaming data from Kafka
Related to Big Data Engineer Resume Samples
Data Collection Resume Sample
Work Experience
• Build lasting relationships with Humana’s customers
• Fluent – in Chinese language as this role is APAC focused
• Willingness to learn and hungry to grow
• Associates or BA (or demonstrated progression for pursuit of an education)
• &nb...
Professional Skills
• Excellent communication, interpersonal and...
• Excellent communication, strong organizati...
• Excellent interpersonal and communication ...
Lead Data Engineer Resume Sample
Work Experience
• Improve and enhance the value provided by Gogo’s Hadoop cluster, in conjunction with the Hadoop Architect, through the application of Apache Spark and other emerging technologies
• Participate heavily in efforts to migrate Gogo’s Big Data cluster from a self-hosted environment to AWS
•&...
Professional Skills
• Strong design & modelling skills and relev...
• Strong in hands on programming skills and ...
• Superior problem solving skills, the abili...
Senior Big Data Engineer Resume Sample
Work Experience
• Experience in dimensional data modeling, ETL development, and Data Warehousing
• Designing, implementing, and testing major subsystems of Eliza’s AWS cloud platform and core service offerings
• Leading and mentoring as a senior member of the Engineering team
•&nbs...
Professional Skills
• Excellent communication and visualization ...
• Outstanding teammate with excellent interp...
• Strong communication skills, good listener...
Data Mgmt Analyst Resume Sample
Work Experience
• Participate in projects and other initiatives per year that influence GOMD and Dell’s strategic objectives
• Management and coordination of configuration/data management system for both commercial and government projects
• Responsible for software configuration, participate i...
Director Data Resume Sample
Work Experience
• Market services to brand Zones Data Center solution capabilities
• BS or MS in Computer Science or other Science/Engineering related field or significant demonstrable professional work experience
• Experience in Finance or Payment Services s industries, with clear understandi...
Professional Skills
• Excellent presentation skills and demonstr...
• Demonstrated experience and skills at arch...
• Possesses excellent people interaction ski...
Data Collection Resume Sample
Work Experience
• Build lasting relationships with Humana’s customers
• Fluent – in Chinese language as this role is APAC focused
• Willingness to learn and hungry to grow
• Associates or BA (or demonstrated progression for pursuit of an education)
• &nb...
Professional Skills
• Excellent communication, interpersonal and...
• Excellent communication, strong organizati...
• Excellent interpersonal and communication ...