Data Engineer Summary Title:
Data Engineer
ID:
1565
Location:
Various
Start Date:
Immediately
Salary:
Negotiable
Clearance:
Top Secret
Description Exciting opportunities for Sr. Data Engineers who will be members of the Data Engineering Scrum Teams. Our ideal candidates will create trends in data sets and develop algorithms to help make raw data more useful to the enterprise. This IT role requires
a significant set of technical skills, including a
deep knowledge of SQL database design and multiple programming languages. But our data engineers also need communication skills to work across departments to understand what business leaders want to gain from the client’s large datasets. Does the thought of exploiting large volumes of data and unlocking the secrets it holds excite you? Do you spend your time keeping up with the advances of the IOT, machine learning and artificial Intelligence? The Defense and Intelligence Communities need your help in efficiently processing massive amounts of structured and unstructured data obtained daily. As a Data Scientist, you can enable access to critical data fragments and assist in forming a cohesive picture of current and future threats - the answers are in the data.
You will have the opportunity to leverage your analytical and technical skills to improve our understanding of current and emerging threats utilizing “Big Data” processing tools. Enable the defense of our Nation and Allies by assisting our customers to formulate their questions and then digging into their data-rich environment to find the pieces of their information puzzle. You’ll develop write scripts, develop algorithms, build predictive analytics, leverage and refine automation concepts, apply machine learning, and use the right combination of tools and frameworks to turn disparate data sets into intelligence enabling our clients to understand the emerging threats and make informed decisions. You will assist our customers to understand their data, build graphical, written, visual, and verbal narrative products on intelligence trends and assist in its use.
The Data Engineer will manage or assist with the gathering of a wide variety of data types from primary and secondary sources through diverse channels using a combination of methods that will be populated into the appropriate analytical tools employed by our Data Analytics team. You will be working with and leading junior team members to perform systems and database maintenance are key components of the work to include designing/implementing ETL pipelines, preservation of source data, performance optimization, monitoring, and suggesting improvements. You will be responsible for:
- Managing the design, development, implementation, maintenance and optimization of a variety of databases and systems to include designing logical and physical database structures, partitioning of tables, data loading and validation, all aspects of security, monitoring, and performance tuning.
- Maintaining database dictionaries, and monitoring standards and procedures
- Providing technical guidance to management, the team, and the customer in regards to implementation of highly advanced technical solutions
- Supporting all dimensions of analysis including data transformations, sourcing, mapping, conversion and loading data
- Collaborate across teams in order to quickly adapt to emerging and dependent technologies
- Continually interact with teams to design and implement innovative data solutions that will provide key decision-making abilities
- Establish and maintain documentation for all design, development, and maintenance activities to include database entity relationship diagrams, ETL processes, source code version control, and automated maintenance processes.
- Perform routine source code reviews of ETL processes for defects, performance tuning, or changes in source data format
- Deliver assignments by established deadlines. Keep management well-informed on a timely basis of progress, status and/or concerns for all team’s assignments
- Develop and maintain standards for database implementation, maintenance, and optimization
- Implement, maintain and test Disaster Recovery methodology for all production databases.
- Reviews performance and capacity planning reports and makes recommendations to management
- Implement, maintain and test Disaster Recovery methodology for all production databases.
- Reviews performance and capacity planning reports and makes recommendations to management
Required Qualifications: - Bachelor's degree or equivalent, and 6-10 years of applicable experience.
- Previous experience with the DoD or intelligence community.
- Experience with managing/leading a team of ETL/Database Administrators
- Strong experience with the design, implementation, administration, and maintenance of a variety of highly complex databases (typically SQL Server, Teradata, DB2, Oracle, MySQL, or PostgreSQL) to include implementing security and access methods
- Strong experience with ETL of large data sets using Python, Teradata, SSIS, or Talend to source, load, and verify data of various formats
- Ability to work at OS level on Linux and Windows, writing scripts and configuring storage
- Experience administrating databases in AWS cloud environments
- Experience with automated tools for database design and implementation
- Ability to embrace and lead technological change and development
- Experience with developing procedures relating to database and application security including procedures by which access is authorized, enabled, changed and withdrawn
- Experience with identifying and implementing enhancements to improve performance and reliability of existing database systems.
- Experience with the implementation, testing, and maintenance of Disaster Recovery for various databases.
- Experience with performing threshold forecasting, sizing, capacity planning, and trend analysis.
- Experience with performance monitoring and summary table creation.
Desired Qualifications: - Strong understanding of the Database Management Body of Knowledge, as well as AI and ML capabilities
- Experience in developing algorithms for execution on cloud and on-premise infrastructure to enable exploitation of enterprise datasets to include production and experimental design
- Experience in using state-of-the-art mathematical and machine learning/artificial intelligence techniques to support exploitation and understanding of data across the enterprise
- Knowledge of computer science concepts, data architecture, and statistics
- Knowledge of statistics and probability, including predictive modeling
- Ability to communicate technical findings to non-technical audiences
- Experience with social network and link analysis tools, including Palantir, i2 Analyst’s Notebook, or Proton
- Experience with ETL and Database management in direct support of Tableau Server
- Experience with schema development, ETL, and database management in IBM I2 Enterprise Insight Analysis (EIA) Opal w/ I2 Connect
Benefits: - Very competitive salary based on qualifications and experience
- Comprehensive, Company paid United Health Care Medical for you and your family (We pay your premiums and deductibles)
- 401(k) & 4% matching
- Travel & performance incentives
- 3 weeks paid time off (plus Federal Holidays)
- $5K annual training allowance
- $500 book allowance
- Tuition reimbursement program
This covers all terms and conditions of employment including (but not limited to):
- Hiring, placement, promotion, transfer, or demotion of all job classifications;
- Recruiting, advertising or solicitation for employment;
- Treatment during employment;
- Rates of pay or other forms of compensation;
- Benefits;
- Selection for training;
- Company sponsored social and recreational activities; and
- Layoff or termination
