Required skills/experience: Extensive Extract, Transform and Load (ETL) and ETL tools, data model analysis, analysis of user interfaces and dataflows, maintain hardware and software performance, develop specifications and performance requirements, solve customer issues, monitor equipment, manipulate data for analysis, develop on cloud environment, Pentaho, Streamsets, NiFi, Airflow, Java, C++, Visual Basic and scripting languages such as Perl, BASH, Python, Oracle and MySQL, writing complex SQL queries, ElasticSearch, Cassandra, MongoDB, Hadoop and/or Spark, hands-on experience working with COTS, GOTS and Open Source capabilities.
Required skills/experience: Extensive Extract, Transform and Load (ETL), data model analysis, analysis of user interfaces and dataflows, maintain hardware and software performance, develop specifications and performance requirements, solve customer issues, monitor equipment, manipulate data for analysis, develop on cloud environment, Pentaho, Streamsets, NiFi, Airflow, Java, C++, Visual Basic and scripting languages such as Python, Perl, BASH, Oracle and MySQL, writing complex SQL queries, ElasticSearch, Cassandra, MongoDB, Hadoop and/or Spark, hands-on experience working with COTS, GOTS and Open Source capabilities.
Required certifications: N/A
Description
• Demonstrated experience in information systems development, focused on bridging engineering, technology, and end user requirements with data owner, legal and policy requirements of data feeds
• Extensive Extract, Transform and Load (ETL) experience, to include data model analysis, mapping various types of data, implementing mappings as ETL routines, and debugging existing ETL routines
• Research, design, develop, and test operating systems level software, compilers and network distribution software for industrial, military, communications, aerospace, business, scientific, and general computing applications and dataflows
• Analyze user interfaces and dataflows, maintain hardware and software performance tuning, analyze workload and computer usage, maintain interfaces with outside systems, analyze downtimes, analyze proposed system modifications, upgrade and new COTS
• Coordinate closely with programmers to ensure proper implementation of program and system specifications
• Review existing programs and assist in making refinements, reducing operating time and improve its performance
• Confer with system analysts, engineers, programmers and others to design system and to obtain information on project limitations and capabilities, performance requirements, and interfaces
• Obtain and evaluate information on factors such as reporting formats required, costs, and security needs, to determine hardware configuration
• Consult with engineering staff to evaluate interface between hardware and software, develop specifications and performance requirements, and resolve customer problems
• Monitor functioning of equipment to ensure system operates in conformance with specifications
• Store, retrieve, and manipulate data for analysis of system capabilities and requirements
• Design, develop, and maintain applications within the cloud environment for new or legacy applications
• Multiple years working with Pentaho, Streamsets, NiFi, Airflow, or similar application for platform deployment, patch deployment, and plugin creation
• Proven development abilities in multiple object-oriented languages such as Java, C++, Visual Basic and scripting languages such as Perl, BASH, Python. Database design and programming on multiple platforms including Oracle and MySQL
• Demonstrated experience writing complex SQL queries, writing data, table and index management statements and understanding database structures, indices, normal forms to improve performance
• Experience with ElasticSearch, Cassandra, MongoDB. Big data platform development and administration including against Hadoop and/or Spark
• Demonstrated hands-on experience working with COTS, GOTS and Open Source capabilities for processing data to meet analytical requirements
