Data Engineer

advise operational processes.We also serve as mediators of meaning across Black Duck, and as custodians of a shared data ecosystem.This ecosystem serves to empower data consumers to explore client-operational and service-ops data in more intuitive ways, and supports their ability to share and collaborate on best practices for using this data in truthful, responsible, ethical and efficient ways.Our ValuesTrust: Our work has no value if it is not trusted by our colleagues/customers, or if our work is not respectable. We will always rather be late than incorrect.Collaboration: We have a "very specific set of skills", however we should humbly respect the subject matter experts we work with in their fields of expertise; we're experts shuffling bits around faster/better/smarter, but they do the real work.Results: For our work to have value, it must speed up, augment, or replace, a current decision making process, or to demonstrate a new product/operational opportunity. While the "value" of a result may not be known for a long time, we are still outcome-driven.Curiosity: Exploration and Experimentation is at the heart of what we do, and we empower each other with the freedom to explore, and possibly get lost in, longer term research projects than other groups. However, even those dead ends have value when they're written up. (It's not science unless you write it down)Fun: We're in this business because we enjoy the strange and often incongruous world of data, and what that data can tell us about ourselves. Revel in the comedy of your mistakes and discoveries, and share them with abandon.About the Role As a Data Engineer/Scientist, you will be a custodian of our cross-functional data regime, and a driver of innovative uses of Data across our cybersecurity platforms, ranging from predictive analytics and customer behavioural analysis, through to training customised machine learning models on continuously evolving feedback streams from data and decisions that really matter to our thousands of customers that rely on our security assessments for safety, stability, and often, sleep.The role is primarily based around our Belfast R&D Site, but UK/EMEA remote or hybrid applicants will be considered. At least Quarterly travel to the Belfast R&D Site is expected, and additional travel / conference opportunities may be available depending on your impact and collaboration.Key ResponsibilitiesDeveloping and maintaining analytical data pipelines from a range of sources, internal and externalParticipate in system design discussions and contribute to architectural decisions.Evaluating new analytical / technological opportunities for leveraging those data for security/business impactLeading projects from research through to production deployment and operational handover to appropriate teamsPartnering with R&D and Engineering teams to develop and share best practices for data tooling, from pipelines and dashboards to ML, Senior Data Scientist - Product Analytics (Contract) Mostly Remote | Ad-hoc London Travel 6 Month Contract | Up to £600/day (Inside IR35) We're looking for a Senior Data Scientist to join our product team, focused on enhancing our multi-tenant digital platform for..., Software Engineer Cloud, Data & APIs Belfast | Hybrid MPA are partnering with an elite Canadian tech firm expanding into Belfast to hire a hands-on Software Engineer to build and scale enterprise-grade cloud, API, and data systems. This role is ideal for engineers who..., Data Center Technical Operations Engineer I Location: London Heathrow LHR186 Contract 6 Months Pay Rate £203 to £226 per day PAYE Hours 40 per week (Shift Based Role On site only) We are hiring Data Center Technical Operations Engineers to support a live data centre..., MCS Group is working with a highly innovative client who is seeking an experienced Data Engineer to support a short-term, high-impact project. This is a short-term contract requirement (likely 2 days per week until the end of April or shortly thereafter). This Data Engineer..., Overview Ocho is delighted to be working on behalf of our client to appoint a Data Engineer to support critical Market Abuse and Communications Surveillance systems. This role sits at the intersection of engineering and operations, ensuring that structured and unstructured...

and LLM integrationKey Qualifications5+ years of experience working in Data Science, AI/Data Engineering, Data Operations, DevOps, Business Analytics, or a related fieldBSc Or MSc in Computer Science, Data Science, Artificial Intelligence, Math, Physics, Engineering or related field/degreeExperience in a relevant analytical programming language the point where you can build / deliver a project/module from scratch that can be used by others (Python is our main daily-driver, expert-level experience in Julia or Rlang could be acceptedExperience in Jupyter Notebook / equivalentsExperience in Airflow, DBT, Databricks, or equivalent stacksExperience in the PyData / Spark or equivalent analytical stacksFamiliarity with Cybersecurity Governance, Application Security Testing, Quality Assurance or similarExperience in data modelling and working with RDBMS (PostgreSQL, Oracle or MySQL) and knowledge of NoSQL databases (e.g. MongoDB)Experience with Machine Learning and AI systemsHands-on experience with AI-assisted development tools (e.g., GitHub Copilot, Claude Code, Cursor, or similar)Independent project operation and cross-functional collaborationStrong or Developingcommunicationskills (in-person and remote)Nice to haveFamiliarity with Data Mesh/Data Product conceptsExperience in operating in Linux Command line environmentsExperience in Langchain or equivalent Agentic development stackExperience in training custom Machine Learning models, including familiarity with evaluation criteria and metric designExperience in integrating AI capabilities into software systems, including prompt engineering, API integration, and leveraging LLM-based services for automation and productivityExperience in Enterprise Data Visualisation such as Power BI, Tableau, Grafana, DataBricks, Snowflake etc.Experience deploying ML/AI models in production environments/workloadsExperience in developing/working within large enterprise applications using microservices architecture, and container orchestration technologies, running on Kubernetes and/or cloud technologies (AWS, Azure or GCP)Experience in software architecture, systems design, interaction design (to the point where you can have constructive conversations with security / architecture leaders)Black Duck considers all applicants for employment without regard to race, color, religion, sex, gender preference, national origin, age, disability, or status as a Covered Veteran in accordance with federal law. In addition, Black Duck complies with applicable state and local laws prohibiting discrimination in employment in every jurisdiction in which it maintains facilities. Black Duck also provides reasonable accommodation to individuals with a disability in accordance with applicable laws.#J-18808-Ljbffr Similar jobs

Black Duck Software, Inc. helps organizations build secure, high-quality software, minimizing risks while maximizing speed and productivity. Black Duck, a recognized pioneer in application security, provides SAST, SCA, and DAST solutions that enable teams to quickly find and fix vulnerabilities and defects in proprietary code, open source components, and application behavior. With a combination of industry-leading tools, services, and expertise, only Black Duck helps organizations maximize security and quality in DevSecOps and throughout the software development life cycle.The Data Science group serves under the Black Duck Data Engineering organization as a center of excellence in data analysis, statistical interpretation, machine learning engineering, attribution analysis and operational metric review.Our core purview is the application of historical data to drive future decision making, and to develop and maintain machine learning and analytical tools to improve service delivery and, Pure Escapes is the world's leading luxury resort wholesaler, specializing in high-end destinations across the Maldives, Seychelles, UAE, and South Africa. We have recently expanded our exclusive portfolio to include new, ultra-luxury destinations such as Mozambique,..., Senior Data Engineer Join a global leader at the forefront of financial markets-this organisation boasts a rich history of connecting clients to vital liquidity and data solutions across the world. As a trusted provider of market infrastructure, they enable secure,..., Senior / Principal Scientist - Medicinal Chemistry Axonis is seeking a Senior / Principal Scientist, Medicinal Chemistry to join its growing team. Axonis is a Boston-based biotechnology company advancing breakthrough drug discoveries to treat neurological disorders. Our..., Palantir Data Engineer Our client is a Leading Digital Transformation Consultancy who have been named a Times Top 100 Company To Work For for 7 consecutive years. As a Palantir Data Engineer, you will join a highly regarded digital, data, and technology consultancy...