Senior Big Data Engineer Resume Sample
Brice Bednar
169 Leatha Path,
New York,
NY
+1 (555) 932 1843
Work Experience
Senior Big Data Engineer
08/2015
-
PRESENT
Chicago, IL
- Experience in dimensional data modeling, ETL development, and Data Warehousing
- Designing, implementing, and testing major subsystems of Eliza’s AWS cloud platform and core service offerings
- Leading and mentoring as a senior member of the Engineering team
- Developing and following best practices relative to design, implementation, and testing
- Producing professional, documented designs
- Prototyping new ideas or technologies to prove efficacy and usefulness in production
- Following agile/Scrum practices
- Rebuilt entire operating platform on cloud technologies after operating for many years on traditional, self-hosted infrastructure components
- Develop SOAP and REST API's to integrate with partners and customers in real-time
Persmod Senior Big Data Engineer
11/2008
-
03/2015
Houston, TX
- Built a generic service structure on AWS that is deployed and scaled to run a variety of platform components dynamically
- Building a next-generation tools platform for creating, managing and deploying multi-channel outreach campaigns in the AWS cloud, designed as a single page web UI and rules engine leveraging .Net, jQuery, WCF, and JSON
- Constructing a state-of-the-art data lake on AWS using EMR, Spark, NiFi, Kafka, Java
- Building voice-enabled applications via SIP
- Exploring AI bots to help answer common healthcare-related questions
- Design and develop large scale, high-volume, and high-performance data structures with large sets of data from different sources
- Provide technical leadership in the Big Data space ( Vertica, Hadoop, SQL Server, Oozie, Hive, Avro, Spark, Scala, Java, Python, RedShift, Scala)
- Select and integrate Big Data tools and frameworks required to provide capabilities required by business functions, while keeping in mind hardware, software & financial constraints
- Build data pipelines that are scalable, repeatable, and secure, and can serve multiple purposes
Education
University of Minnesota, Morris
2003 - 2008
Engineer's Degree in Computer Science
Professional Skills
- Excellent communication and visualization skills, with the ability to synthesize disparate data and information into a strong narrative
- Outstanding teammate with excellent interpersonal skills and the ability to work in a fast-paced environment
- Strong communication skills, good listener, comfortable giving presentations
- Quick Learner and Self-starter with excellent debugging skills
- Frequent interactions with external customers at the Director level or above; established consulting and interpersonal skills with 5+ years' experience
- Communicate comfortably, at different levels, with different stakeholders · Excellent communication and collaboration skills
- Proven experience designing, building and operating in-production big data/stream processing and/or enterprise data warehouse is required
How to write Senior Big Data Engineer Resume
Senior Big Data Engineer role is responsible for software, compensation, database, scripting, training, integration, security, shipping, java, coding.
To write great resume for senior big data engineer job, your resume must include:
- Your contact information
- Work experience
- Education
- Skill listing
Contact Information For Senior Big Data Engineer Resume
The section contact information is important in your senior big data engineer resume. The recruiter has to be able to contact you ASAP if they like to offer you the job. This is why you need to provide your:
- First and last name
- Telephone number
Work Experience in Your Senior Big Data Engineer Resume
The section work experience is an essential part of your senior big data engineer resume. It’s the one thing the recruiter really cares about and pays the most attention to.
This section, however, is not just a list of your previous senior big data engineer responsibilities. It's meant to present you as a wholesome candidate by showcasing your relevant accomplishments and should be tailored specifically to the particular senior big data engineer position you're applying to.
The work experience section should be the detailed summary of your latest 3 or 4 positions.
Representative Senior Big Data Engineer resume experience can include:
- Excellent oral, written communication skills and presentation skills
- Your excellent collaboration skills to work with multiple teams in the organization
- Prior experience of implementing reporting solution in one or multiple areas such as Retail, Sales/Supply Chain & Operations/Finance/Marketing
- Capable of developing in Java and Scala with good understanding of functional programming, SOLID principles and, concurrency models and modularization
- Experience coding in Python or Java, with solid CS fundamentals including data structure and algorithm design
- Proven experience in developing Big Data Pipelines in a Hadoop Ecosystem using, Hive, Spark on Yarn, DataPlane
Education on a Senior Big Data Engineer Resume
Make sure to make education a priority on your senior big data engineer resume. If you’ve been working for a few years and have a few solid positions to show, put your education after your senior big data engineer experience. For example, if you have a Ph.D in Neuroscience and a Master's in the same sphere, just list your Ph.D. Besides the doctorate, Master’s degrees go next, followed by Bachelor’s and finally, Associate’s degree.
Additional details to include:
- School you graduated from
- Major/ minor
- Year of graduation
- Location of school
These are the four additional pieces of information you should mention when listing your education on your resume.
Professional Skills in Senior Big Data Engineer Resume
When listing skills on your senior big data engineer resume, remember always to be honest about your level of ability. Include the Skills section after experience.
Present the most important skills in your resume, there's a list of typical senior big data engineer skills:
- Strong, practical OO experience, e.g., understanding and employing SOLID principles
- Your expertise in languages such as Python, Ruby, Go, JavaScript and Java, as well as strong Unix shell skills
- Strong relational databases and SQL skills
- Good communication skills to interact with team members and senior management
- Team player with excellent interpersonal skills and the ability to work in a fast-paced environment
- Excellent communication skills in order to lead the client engagement
List of Typical Experience For a Senior Big Data Engineer Resume
1
Experience For Persmod Senior Big Data Engineer Resume
- Experience with software engineering standard methodologies (e.g. unit testing, performance testing, code reviews, design documentation)
- Experience with Hadoop distributions and related technologies for ingesting, indexing and analysing large amounts of data (e.g. Cloudera stack)
- Strong programming exposure in one or many languages including JAVA, Python, Scala
- Python programming experience, SQL (Scala- advantage)
- Participate in validation and verification testing phases when necessary
- Experience developing high-throughput or high-volume applications
- Experience in information technology and/or professional services, with emphasis on working on Big Data platforms
- Experience in using Hadoop, Spark, MapReduce, HDFS, Hive, KAFKA, Sqoop and OOZIE and other open source tools
2
Experience For MQM Senior Big Data Engineer Resume
- Experience in working No-SQL data stores such as HBase / RedShift / Cassandra / Mongo DB etc
- Experience with Teradata, SQL, IBM DataStage, Hadoop, Unix Scripting
- Experience with Hadoop stack (HIVE, Pig, Hadoop streaming) and MapReduce
- Experience in one or more of the following languages: Java, C#, Python/Jython, Scala, Clojure, Ruby, C++
- Experience implementing open source technologies
- Experience in Test Driven Development using Frameworks
- Experience in one or more analytical modeling tools/workbench (Jupyter or Zeppelin)
- Experience with Hadoop, Spark, and Large scale data processing
3
Experience For Senior Big Data Engineer Resume
- Experience with building data pipelines and services
- Experience in any scheduling tools such as IBM Tivoli Workload Scheduler, Control M, AutoSys, etc required
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
- Experience with at least one object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
- Experience in implementing Big data solutions in data analytics space
- Experience in developing Big data applications in Cloud (AWS, Azure, Google Cloud)
- Experience with Hadoop, Data Warehousing and Teradata SQL
- Experience in distributive computing tools (Spark, Hive)
4
Experience For Persmod Senior Big Data Engineer Resume
- Experience with programming languages (Java, Python, and Scala)
- Experience in Java or Python programming
- Experience developing ETL
- Proven facility for thinking system wide and translate business requirements into code
- Previous experience building a production system on AWS (IaaS/PaaS)
- Hands-on experience developing high availability, scalable, medium to large scale ETL and Data Warehouse systems
- Hands on experience with integration of data from multiple data sources, and processing large amounts of structured and unstructured data
- Operate Apple’s largest infrastructure supporting millions of Siri customers at double digit PB scale
5
Experience For MQM Senior Big Data Engineer Resume
- Experience working on AWS, Azure or other cloud providers for big data
- Experience working in real-time data ingestion is required
- Experience working on Talend would be ++
- Most likely have 5+ years of experience working with general software development, preferably Java and/or Python
- Might have experience with Machine Learning, but this is not a requirement
- Knowledge and experience with UNIX/Linux operating system administration
6
Experience For Senior Big Data Engineer Resume
- Experience Developing Models that help Predictions
- Strong understanding of MapReduce, Spark, and PigLatin
- Experience with data transformation and reporting tools on Oracle,SQL and Teradata databases
- Proven understanding with Hadoop, HBase, Hive,Pig, and HBase
- Hands on experience with object oriented programming languages
- Experience working in an Agile/ Scrum environment
7
Experience For Persmod Senior Big Data Engineer Resume
- Consolidate delivery status and agreed costing information across the project stakeholders
- Develop and operate our data pipeline & mange data infrastructure
- Experience in Business Intelligence and Data Warehousing
- Hands-on experience with BigData and Cloud ecosystems
- Operate within Agile Development environment and apply the methodologies
- Experience with web services, API design, OLAP/Business Intelligence
- Experience with source control solutions (ex git, GitHub, Jenkins, Artifactory) required
8
Experience For MQM Senior Big Data Engineer Resume
- Experience with big data and the Hadoop ecosystem (HDFS, SPARK, SQOOP, Hive, Impala, Parquet) required
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift, S3
- Innovate our area with your experience in software development
- Act as a role model and mentor for our less experienced big data engineers
- Experience in retail and/or e-commerce
9
Experience For Senior Big Data Engineer Resume
- Five+ years of programming language experience required, preferably in Java, R or Python
- Experience with open source big data processing systems and infrastructure such as Spark, Hive, PrestoDB, etc
- Experience in programming languages: Java, Scala, Javascript
- Experience in Continuous Integration, Testing & Automation frameworks (e.g. Jenkins, Bamboo, …)
- Experience in programming languages like Java, Python, Scala
- Demonstrated advance proficiency writing complex SQL queries and stored procedures
- Experience developing in one or more object-oriented or functional languages
- Experience with Spark, Kafka, Hadoop, and Streaming Data
- Experience with Big data tools and technologies
10
Experience For Persmod Senior Big Data Engineer Resume
- Experience with Hadoop and related technologies such as Spark, Hive, Impala
- Experience in C, Java, or Scala
- Experience with recognized industry patterns, methodologies, and techniques
- Experience with Spark, Scala and/or Akka
List of Typical Skills For a Senior Big Data Engineer Resume
1
Skills For Persmod Senior Big Data Engineer Resume
- Your excellent communication skills, both through written and verbal channels
- Excellent understanding and experience working with Hadoop Systems, HBASE, Spark, Kafka and Elastic Search
- Experience coding in Java, Python, or Scala, with solid CS fundamentals including data structure and algorithm design
- Proven experience with building and optimizing data pipelines, architectures, and datasets from both structured and unstructured datasets
- Proven experience in developing Big Data Pipelines in a Hadoop Ecosystem using Hive, Spark on Yarn, DataPlane
- Proven experience designing and implementing large-scale or complex commercial software systems
- Expertise in managing Cassandra using DataStax Enterprise Edition. Strong experience with either Java or Scala
- Effectively roll out new features using an Agile methodology
2
Skills For MQM Senior Big Data Engineer Resume
- Experience with Unix/Linux systems with scripting experience in Shell, Perl or Python
- Strong problem-solving capabilities and exhibits strong Computer Science Fundamentals
- Proven experience with Big Data migrations/transformations programs in the Data Warehousing and/or Business Intelligence areas
- Strong experience with Big Data Technology, including Hadoop, MapReduce, Spark is needed
- Preferably have 3+ years of experience working with big data as well as practical experience with Spark
- Strong experience with ELT, specifically around data wrangling and transformation
- Understand, leverage and applies best practices effectively. Also leads by example and comes up with coding standards and best practices for technology
- Strong system design/development experience in building large scale distributed systems and products
- Amazon EMR / Athena skills are a benefit but not critical
3
Skills For Senior Big Data Engineer Resume
- Proven experience using the Microsoft development tools and stack, e.g., TFS, Github, Eclipse, JVM, etc
- Proven experience dealing with “big” (multi-terabyte) data
- Strong experience with enterprise application architecture and enterprise integration patterns
- Strong experience in Spark Python/ Scala and Java is needed
- Experience supporting Hadoop environments including experience with HDFS, HBase, Hive and other related technologies required
- Designing, Building and supporting mission critical applications to provide the best customer experience
4
Skills For Persmod Senior Big Data Engineer Resume
- Programming experience in Scala, Java, Python and/or C++
- Experience with building stream-processing systems using solutions such as spark-streaming, Storm or Flink etc
- Three+ years of corporate experience designing, building and operating in-production big data/stream processing and/or enterprise data warehouse is required
- Experience designing, documenting, and defending designs for key components in large distributed computing systems
- Experience in Deploying, maintaining and building apps on distributed stream processing engines such as Storm, Flink, Nifi, Spark etc
- Experience in delivering big data solutions using a leading Hadoop distributions like Hortonworks, Cloudera, MapR
5
Skills For MQM Senior Big Data Engineer Resume
- Experience with learning, mentoring others, and collaborative knowledge sharing
- Experience designing, developing, and implementing ETL pipelines
- Experience in Hadoop framework, large scale data processing (eg. Spark), messaging service (eg. Kafka), report templating (eg. Jasper)
- In the software engineering profession with demonstrated success designing and building high-quality, commercial software applications
- Experience in designing and developing large scale applications utilizing Big Data technologies
- Experience of coaching, guiding and developing junior data analysts
- Experience working with and performing analysis using large data sets
- Experience configuring, deploying and monitoring applications in AWS
6
Skills For Senior Big Data Engineer Resume
- Working experience in developing and doing integration projects for enterprise level solutions
- Extensive experience with SQL for extracting and aggregating data
- Experience working within a cloud computing model
- Experience with Design Thinking methodology, rapid prototyping, and minimal viable product development
- Three+ years of experience using data management tools, including SQL/DBMS and NoSQL is required
7
Skills For Persmod Senior Big Data Engineer Resume
- Experience in functional programming in Scala, especially in Spark programming
- Experience working on projects facilitating true CI/CD (Jenkins, Drone, etc.)
- Experience working with Web Application, Rest Services, Spring Framework, Java, Javascript is desired, not required
- Proven success delivering Big Data solutions leveraging Hadoop, Kafka, or Spark
- Experience working in a Data Warehousing environment
- Experience as a Scrum Master implementing Agile best practices and providing team leadership
- Professional experience in big data engineering or an adjacent field with an established track record of making things that work
- Experience building Data Lakes and processing Data streams
- Experience using data management tools, including SQL/DBMS and NoSQL technologies like HBASE, Cassandra, Elastic Search is required
8
Skills For MQM Senior Big Data Engineer Resume
- Experience building data transformation layers, ETL frameworks using big data technologies such as Hive, Spark, Presto etc
- Deep experience doing data analyses using Structured Query Language (SQL)
- Experience building "big data" applications using Scala, Hive, Python
- Experience using high-throughput, message queueing systems such as AWS SQS
- Experience building tools & frameworks for a team of 30+ developers building features for a large-scale consumer website
- Experience in Data Streaming, Ingestion using Kafka, Zookeeper, Storm, Spark, Hadoop & Hbase
- Experience designing and delivering production software
- Experience building and operating at scale
9
Skills For Senior Big Data Engineer Resume
- Strong desire to work in a fast paced, exiting, growing, environment and make it a success
- Good knowledge in back-end programming,specifically Java, JS, Shell scripting, and Sqoop
- Experience in Handling unstructured data / Big data / Data Warehousing on distributed system
- Experience building and operating at scale ·
- Good understanding of building consumption frameworks on Hadoop, AWS, Azure or GCP (Restful services, Self-service BI and Analytics
- Experience with stream-processing systems: Storm, Spark-Streaming, etc
- Experience working to optimize and scale reporting technologies (Tableau, Qlick, Domo)
- Experience in dimensional data modeling, ETL development, and Data Warehousing
- Experience in using Scrum process
10
Skills For Persmod Senior Big Data Engineer Resume
- Real world experience using Hadoop and the related query engines (Hive / Impala)/Hbase
- Experience with reporting tools such as Tableau, Qlikview
- Experience with developing against NoSQL data stores
- Experience of conducting data analyses with cloud based technologies (preferably AWS)
- Experience building data pipelines
- Experience with leading big and fast data technologies like Spark, Scala, Akka, Cassandra, Accumulo, Hbase, Hadoop, HDFS, AVRO, MongoDB, Mesos
- Experience with Spark Streaming, Storm, Flink, or other Stream
- Experience providing technical leadership towards development of a product or platform
List of Typical Responsibilities For a Senior Big Data Engineer Resume
1
Responsibilities For Persmod Senior Big Data Engineer Resume
- Effectively collaborate with onsite and offshore teams for Big Data Solution Delivery
- Effectively collaborate with on site and offshore teams for Big Data Solution Delivery
- Experience standing up and deploying solutions on top of the following AWS technologies using AWS CLI: EMR, EC2, S3, Redshift, Dynamo, Kinesis
- Proven track record in working with internal customers to understand their analytic usecases, and developing technology to enable analytic insight at scale
- Experience with supporting data scientists and complex statistical use cases highly desirable
- Experience working closely with product management and designers throughout the product development process
2
Responsibilities For MQM Senior Big Data Engineer Resume
- Some experience with machine learning models
- Very strong knowledge of Data warehousing concepts
- Programming language experience required, preferably in Java
- Your ability to understand and adapt to changing business priorities and technology advancements
- Your strong knowledge and technology trends in implementing of Big data ecosystem
3
Responsibilities For Senior Big Data Engineer Resume
- Your solid understating of data architecture patterns such as Lambda, Kappa, Event driven Architecture, Data as a Service, Microservice etc
- Overall 8+ years of experience in programming/development with 4+ years in big data related work
- Advanced skill level in at least two of the following with competency in the others: Java, Scala, Python, R
- Experience working in a big data environment
- Experience building high-performance, highly-available and scalable distributed real-time analytical solutions
- Expert-level Java development experience, including common backend frameworks
4
Responsibilities For Persmod Senior Big Data Engineer Resume
- Experience with highly-scalable and distributed databases and the key issues affecting their performance and reliability
- Overall, 7+ years of industry experience developing backend components with a recent focus on big data systems
- Experience with streaming technologies like Kafka, Spark, Flink, Samza
- Experience in Data Management, Data Modeling with Oracle/DB2
- Experience with Data Mining, ETL/ELT in Informatica, Spark
- Experience of API Development, Fast Access Layer in Micro services including Solr, Lucene, Splunk, Kafka and Storm
- Experience in building Big Data Lake, DWH, Analytics with Hadoop, Hive, Hbase, MapReduce, Tez & Spark
- Experience of working in Agile and Lean environments
5
Responsibilities For MQM Senior Big Data Engineer Resume
- Hadoop experience developing analytics and other solutions
- Need a strong and deep understanding of the Hadoop ecosystem
- Experience working with un-structured or semi-structured data (i.e. Apache Avro)
- Experience working with big data technologies such as AWS and Hadoop
- Experience with AWS APIs, cloud provisioning frameworks and orchestration technology, preferably AWS EMR
- Expert Java developer with experience building API’s
- Working experience in Python, Json, Hive, Pig, Spark, Scala, Oozie or Sqoop, storage formats Text/ORC/Parquet
- Experience working with data visualization tool such Tableau
6
Responsibilities For Senior Big Data Engineer Resume
- Experience with setting up infrastructure on AWS
- Experience leading cross functional solutions
- Experience participating in an Agile software development team, e.g. SCRUM
- Experience in one or more languages such as Java, Python, R, and Scala
- Experience with Kinesis or Apache Kafka
- Business Intelligence delivery experience
7
Responsibilities For Persmod Senior Big Data Engineer Resume
- Experience with large scale, concurrent applications
- Proved experience in OLAP implementions on Hadoop. Apache Kylin, Druid, AtScale etc
- Strong knowledge of Data as a Service principles
- Experience with performance optimization for Spark & Hive SQL Workloads
- Experience with multiple Apache Hadoop applications like Hadoop, Hive, Oozie, Pig, Presto etc
- Experience with NoSQL AWS data stores like DynamoDB, CloudSearch, or their open source equivalents like Cassandra, HBase, Solr, or ElasticSearch
- Experience with database schema design (SQL/NoSQL)
- Experience with Code/Build/Deployment tools such as git, maven, jenkins
8
Responsibilities For MQM Senior Big Data Engineer Resume
- Experience with the Hadoop stack
- Proved experience in OLAP implementations on Hadoop. Apache Kylin, Druid, AtScale etc
- Experience in Rest API development
- Experience with relation database such as MySQL, Oracle, DB2 etc
- Experience with Hortonworks, Cloudera, or MapR
- Experience with applied data science
- Experience with web technology to develop dashboards
9
Responsibilities For Senior Big Data Engineer Resume
- Experience in Data Management
- Experience with Hadoop stack (Map Reduce, Kafka, Pig, Hive, HBase, Cassandra, YARN) and/or BDAS (Scala/Spark)
- Experience in big data analytic
- Experience with the setup and administration of Hadoop, and the use of Hive and Pig
- Experience with the setup and administration of Hadoop, and the use
- Linux experience
10
Responsibilities For Persmod Senior Big Data Engineer Resume
- Hands on experience with NoSQL databases, SQL databases and Vertica
- Designing, Developing and maintaining batch data flow using Sqoop, Hive QL, Pig and Unix scripting
- Designing, building and support data processing pipelines to transform data using Hadoop technologies
- Building Scalable Data Pipelines for generating training datasets for machine learning deliverables
- Identifying and ingesting new data sources and performing feature engineering for integration into models
- Building real-time data pipelines using Kafka, Spark, Storm, Flume, and similar stacks on leading cloud platforms
Related to Senior Big Data Engineer Resume Samples
Big Data Engineer Resume Sample
Work Experience
• Support, maintain, and document Hadoop and MySQL data warehouse
• Iterate and improve existing features in the pipeline as well as add new ones
• Design, develop, document, and test new requirements in the data pipeline using PERL, BASH, PIG and OOZIE in the Hadoop ecosystem
...
Professional Skills
• Very strong skills working with very large...
• Demonstrated excellent planning and organi...
• Proven design, coding, testing and debuggi...
Data Conversion Resume Sample
Work Experience
• Participate in requirements analysis sessions and develop design specifications for each module they are responsible for, including facilitate the session
• Develop clear and concise documentation that facilitates repeatable migration of the applications or processes
• Act as...
Professional Skills
• Sets expectations around data conversion w...
• Strong problem solving and analytical skil...
• Proven strong organizational skills and de...
Senior Data Engineer Resume Sample
Work Experience
• Experience building large scale high performance distributed systems
• Provide technical leadership to the data team in the time of big change in technology – adopting of open source
• Lead the team in designing and development of automated data flow processes
•&n...
Professional Skills
• Outstanding presentation skills, strong st...
• Excellent problem solving, critical thinki...
• While keeping business objectives in sight...
Data Mgmt Analyst Resume Sample
Work Experience
• Participate in projects and other initiatives per year that influence GOMD and Dell’s strategic objectives
• Management and coordination of configuration/data management system for both commercial and government projects
• Responsible for software configuration, participate i...
Director Data Resume Sample
Work Experience
• Market services to brand Zones Data Center solution capabilities
• BS or MS in Computer Science or other Science/Engineering related field or significant demonstrable professional work experience
• Experience in Finance or Payment Services s industries, with clear understandi...
Professional Skills
• Excellent presentation skills and demonstr...
• Demonstrated experience and skills at arch...
• Possesses excellent people interaction ski...
Data Collection Resume Sample
Work Experience
• Build lasting relationships with Humana’s customers
• Fluent – in Chinese language as this role is APAC focused
• Willingness to learn and hungry to grow
• Associates or BA (or demonstrated progression for pursuit of an education)
• &nb...
Professional Skills
• Excellent communication, interpersonal and...
• Excellent communication, strong organizati...
• Excellent interpersonal and communication ...