Sr. Engineer Generative AI

Remote, USA

Sr. Engineer Generative AI

Category: Software Development/ Engineering

Main location: United States, Remote

Alternate Location(s): United States, Virginia, Sterling

United States, South Carolina, Columbia

United States, Louisiana, Lafayette

Position ID: J1023-0872

Employment Type: Full Time

Meet our professionals

U.S. - What we do matters

Position Description:

CGI has an immediate need for an Sr. Engineer Generative AI to join our financial services team in Columbia, SC, Sterling, VA or Lafayette, LA. This is an exciting opportunity to work in a fast-paced team environment supporting one of the largest leaders in the secondary mortgage industry. We take an innovative approach to supporting our client, working side-by-side in an agile environment using emerging technologies.

• We partner with 15 of the top 20 banks globally, and our top 10 banking clients have worked with us for an average of 26 years!

• We have over 73,000+ CGI Members in 40 countries and over 5k+ loyal Clients who are leveraging our end-to-end services across the globe.

Your future duties and responsibilities:

We are looking for an experienced Generative AI Systems engineer, to help us build the foundations of our enterprise AI Capabilities. You will work on a wide range of initiatives, whether that’s designing robust, secure infrastructure, building large-scale distributed training clusters, deploying LLMs on GPU instances for real-time use cases, or supporting cutting-edge AI research and development, all in our public cloud infrastructure. You will work with a team of AI engineers and researchers to envision the target state of our capabilities while helping to design and implement key services.

Examples of projects you will work on include:

• Design and build fault-tolerant infrastructure to support long-running large-scale training tasks reliably despite failure of individual nodes, using containers and check-pointing libraries.

• Design and build infrastructure for serving large ML models, in our public cloud.

• Deploy a thousand-node training cluster optimizing storage and networking stack, with tightly coupled training pipelines to take advantage of multiple parallelism strategies, in our public cloud.

• Design and implement benchmarks to measure the performance of software systems within AI capabilities and make recommendations on technology selection

• Develop applications that leverage LLMs and FMs.

• Design and implement capabilities to support MLOps for foundation models.

Required qualifications to be successful in this role:

Experience designing large-scale distributed platforms and/or systems in cloud environments such as AWS, Azure.

• Experience architecting cloud systems for security, availability, performance, scalability, and cost.

• Experience with delivering very large models through the MLOps life cycle from exploration to serving.

• Experience with building GPU clusters in the public cloud with tightly-coupled storage and networking.

• Experience with the complete stack for distributed training of large models including ML compilers, distributed training frameworks​​, and ML development frameworks such as Pytorch, Tensorflow, Lightning etc.

• Experience with one or multiple areas of AI technology stack including prompt engineering, guardrails, vector databases/knowledge bases, LLM hosting and fine-tuning.

• Authored research publications in top peer-reviewed conferences, or industry-recognized contributions in the space of neural networks, distributed training and SysML.

•9+ years of professional experience.

•7+ years of experience programming in Python or R.

•5+ years of experience with Natural Language Processing (NLP) and Large Language Models (LLM)

•3+ years of experience building and maintaining scalable API solutions.

Desired Skillset

​Cloud specialty certification in M/L


​Bachelor's in computer science or equivalent



CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $75,600.00 - $165,300.00.

At CGI we call our professionals “members” to reinforce that all who join our team are, as owners, empowered to participate in the challenges and rewards that come from building a world-class company. CGI’s benefits include:

• Competitive base salaries

• Eligibility to participate in an attractive Share Purchase Plan (SPP) in which the company matches dollar-for-dollar contributions made by eligible employees, up to a maximum, for their job category

• 401(k) Plan and Profit Participation for eligible members

• Generous holidays, vacation, and sick leave plans

• Comprehensive insurance plans that include, among other benefits, medical, dental, vision, life, disability, out-of-county emergency coverage in all countries of employment.

• Back-up childcare, Pet insurance, a Member Assistance Program, a 529 college savings program, a personal financial management tool, lifestyle management programs and more


  • Python

What you can expect from us:

Insights you can act on

While technology is at the heart of our clients’ digital transformation, we understand that people are at the heart of business success.

When you join CGI, you become a trusted advisor, collaborating with colleagues and clients to bring forward actionable insights that deliver meaningful and sustainable outcomes. We call our employees “members” because they are CGI shareholders and owners and owners who enjoy working and growing together to build a company we are proud of. This has been our Dream since 1976, and it has brought us to where we are today — one of the world’s largest independent providers of IT and business consulting services.

At CGI, we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer, we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist.

Ready to become part of our success story? Join CGI — where your ideas and actions make a difference.

Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics.

CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at . You will need to reference the Position ID of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a Position ID will not be returned .

We make it easy to translate military experience and skills! Clickhere ( to be directed to our site that is dedicated to veterans and transitioning service members.

All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances.

CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI’s legal duty to furnish information.