Analyst Programmer (Government Sector, AI/ LLMs)

Salary: $45,000 – $52,000 per month

A HKSAR Government Department
Selected candidate will be assigned to work in government department and responsible for the implementing and supporting artificial intelligence (AI) and Generative AI projects.

Responsibilities:

· To asssit in conducting technical studies, proof-of-concept exercises and evaluations of AI technologies, including LLMs, AI computing hardware, software platforms, model serving solutions and open-source AI technologies

· To perform hands-on installation, configuration, deployment, integration, testing and troubleshooting of AI models and AI-related software components in on-premises, virtualised, containerised or other computing environments

· To assist in deploying and configuring LLMs and other AI models, including model selection, model configuration, inference serving, quantisation, model optimisation and integration with application systems and APIs

· To assist in evaluating and configuring AI computing infrastructure and hardware, including CPU, GPU, NPU, memory, storage and network requirements, and to assist in capacity planning, resource sizing and performance optimisation for different AI workloads

· To explore, test and implement suitable open-source AI models, frameworks, libraries and platforms, including assessment of their functionalities, compatibility, performance and suitability for departmental use

· To assist in developing, implementing and integrating AI applications and supporting components, including retrieval-augmented generation (RAG), knowledge bases, vector databases, AI agents, AI guardrails and other related technologies where applicable

· To conduct functional testing, model evaluation and performance benchmarking, including evaluation of model quality, accuracy, response latency, throughput, concurrency, resource utilisation, scalability and other relevant performance indicators

· To assist in the preparation and implementation of data preparation, model evaluation, prompt design, retrieval and knowledge management approaches required by AI applications

· To coordinate with user divisions, internal IT teams, contractors, vendors and service providers on requirements analysis, architecture design, implementation, integration, testing, deployment and ongoing support of AI solutions

· To assist in monitoring project progress and contractor deliverables to ensure compliance with technical requirements, quality standards, implementation schedules, security requirements and contractual obligations

· To assist in assessing AI security and governance requirements, including data protection, access control, model security, prompt injection, sensitive information leakage, AI output risks, software supply-chain risks and other AI-related security concerns

· To prepare and review technical documentation, including architecture designs, technical specifications, evaluation reports, benchmark reports, implementation plans, testing plans, operating procedures and project progress reports

· To assist in preparing technical specifications and conduct technical evaluation for the procurement of AI hardware, software, platforms, models and related professional services

· To provide technical support and troubleshooting for AI infrastructure, AI platforms, models and related application services, including investigation of performance, compatibility and operational issues

· To keep abreast of developments in AI technologies, LLMs, open-source AI ecosystems and AI infrastructure, and to assess their potential application in the Department

· To be able to work under pressure, willing to work overtime if required on other ICT related duties

· To perform other AI-related, application-related or ICT duties as assigned by the supervisor or the Government Representative from time to time

Requirements:

· Bachelor’s degree Holder or above in IT/ Computer Science or related discipline

· At least 4 years of hands-on experience software development experience across both front- and back-end technologies

· At least 2 years working experience in AI, machine learning, Generative AI, or other related technical areas

· Solid knowledge of LLM technologies and their implementation, including model inference, tokenisation, context handling, prompt processing, model serving, quantisation and performance optimization

· Solid knowledge of AI computing infrastructure and hardware, including CPU, GPU, NPU, memory, storage, networking and their impact on AI model deployment and performance

· Solid experience with Linux environments, scripting and container technologies, and practical knowledge of deploying applications or AI workloads using containers

· Solid experience with programming or scripting languages commonly used in AI development and integration, such as Python, and experience in integrating systems through APIs

· Solid knowledge of the open-source AI ecosystem, including open-source LLMs, model repositories, AI frameworks, inference engines and related tools

· Solid experience in evaluating AI solutions in terms of functionality, performance, resource utilisation, scalability and suitability for production use

· Solid experience in preparing technical documentation, architecture designs, technical specifications, evaluation reports and project deliverables

· Solid experience in coordinating contractors, vendors, users and technical teams in the implementation of IT or AI projects

· Candidates with solid experience/ skills below will be advantageous:

- Deploying open-source LLMs or Generative AI solutions in an on-premises environment

- Model serving and inference technologies

- Model optimization

- Quantisation or distributed AI inference

- Retrieval-Augmented Generation (RAG), vector databases,

- Embedding models, reranking, knowledge bases or AI agent technologies

- AI infrastructure capacity planning, GPU/NPU resource management

- Performance benchmarking or high-performance computing

- AI security, model governance, security risk assessment or implementation of security controls for AI systems

- Implementing AI solutions in large-scale environments

How to Apply:
To apply for this position, please simply click on the “APPLY” button or send your full resume in Word format to tommy.yeung@persolapac.com indicating the job title.

If you are not contacted by our consultants within 2 weeks, please consider your application unsuccessful. All applications will be treated in strict confidence and used for recruitment purposes only in accordance with PERSOL Hong Kong Limited’s Privacy Policy.

PERSOL Hong Kong Limited: Employment Agency Licence No. 84424