Infrastructure Engineer

Mô tả công việc:

As an Infrastructure Engineer at KiotViet your goal is to keep our core infrastructure -
Datacenter, Firewall, Network, Storage and Cloud Services - stable, observable and ready to
scale. Our datacenters run in an active/active model where every site serves production traffic,
so the stability of each site directly impacts all running products. You, together with other
members of the Infrastructure team, will take part in building, expanding and maintaining our
datacenters, while taking ownership of infrastructure monitoring: operating, standardizing and
gradually upgrading the current monitoring system toward full observability, turning it into the
key tool for detecting risks before they become incidents.
We welcome candidates who do not yet meet the full tooling requirements, as long as they have
solid fundamentals and the right mindset - the team provides a structured training roadmap
during the first 6 months.

Responsibility
- Work with the current team to build, expand and maintain our datacenters: deploying
servers, virtualization platforms, storage and shared infrastructure services.
- Contribute to the high availability of the active/active model: monitoring synchronization
status between sites, detecting early signs of load imbalance or capacity degradation on
any site.
- Join the on-call rotation of the department - the schedule is shared equally among team
members by day of week; no single position is on-call continuously.
- Propose automation improvements for infrastructure operations.
- Operate and improve the centralized monitoring system for the entire infrastructure layer:
physical servers, virtualization, network, storage and platform services in the datacenter.
- Standardize the collection of metrics and logs for all systems under the Infrastructure
Department's scope; gradually introduce tracing capability following the observability
roadmap.
- Build and optimize the alerting system: defining thresholds, alert rules and severity
levels, and reducing alert fatigue.
- Build dashboards for daily operations, capacity reporting and system health visibility for
management levels.
- Define and track infrastructure service quality indicators (uptime, latency, error rate) as
the basis for internal commitments.
- Coordinate with DevOps/Platform teams in the product development division to
cross-check monitoring data between the infrastructure layer and the application layer
during incident investigation.
- Write operational runbooks for alert scenarios and monitoring incident-handling
procedures.

Yêu cầu công việc:

Education
- Bachelor's degree in IT, Engineering, or a related field;

Skills and Experience Requirements
- 4+ years of hands-on experience operating monitoring systems in production environments, including configuration and improvement - not only watching dashboards.
- 4+ years of experience working with Linux server infrastructure in production environments.
- Proficiency in at least one common monitoring stack: Zabbix, Prometheus + Grafana, ELK/OpenSearch, or equivalent.
- Ability to design and fine-tune alerting: setting reasonable thresholds, classifying severity levels, handling alert fatigue.
- Ability to exploit monitoring data for troubleshooting: moving from abnormal signals in metrics and logs to isolating the -root cause - independent of any specific tool.
- Experience monitoring hardware devices (servers, switches, routers, firewalls) via at least one of the following: SNMP protocol (OID, MIB, trap) or out-of-band management (IPMI, iDRAC, iLO).
- Solid fundamentals in networking (TCP/IP, DNS, VLAN, basic routing) and storage (SAN/NAS, RAID).
- Experience with at least one virtualization platform: VMware, KVM, or equivalent.
- Experience using Ansible for configuration management and operational automation.
- Basic working knowledge of Docker: packaging, running and monitoring containers.
- Scripting skills (Bash, Python) for operational automation and monitoring data collection.
- Systems thinking, self-organization and the ability to own an independent technical domain.
- Growth mindset - willingness to develop expertise toward observability.
- Clear technical documentation skills.
- Cross-team collaboration skills - this position works regularly with teams in the product development division.

Preferred Qualifications
- Experience designing a monitoring architecture from scratch (tool selection, data collection - storage - visualization pipeline) is a plus.
- Knowledge or experience in observability (three pillars: metrics - logs - traces, OpenTelemetry, or modern telemetry standards) is a plus.
- Proficiency in monitoring query languages (PromQL, Lucene/KQL, or equivalent) is a plus.
- Experience with Terraform (complementing Ansible in the department's Infrastructure as Code toolset) is a plus.
- Proficiency in both hardware monitoring skill sets (SNMP and IPMI/iDRAC/iLO) is a plus.
- Knowledge or experience with Kubernetes (operating or monitoring clusters) is a plus.
- Experience with in-depth physical datacenter monitoring (environmental sensors, power - cooling systems) is a plus.
- Experience building monitoring systems for multi-datacenter or hybrid cloud environments is a plus.
- Relevant certifications (LPIC, CCNA, CCNP or cloud certifications) are a plus.

Why Join Us?
- Work directly with a multiple-datacenter infrastructure running in an active/active model -
a technical environment at a scale few companies in Vietnam can offer.
- Access and operate a large-scale HCI (Hyper-Converged Infrastructure) system.
- Work with the core ecosystem of Cloudflare services within the company's infrastructure
architecture.
- Structured training and career development toward observability.

Quyền lợi & Chính sách:

- Compensation, a 13th month salary depending on employee’s performance;
- Performance bonus (up to 2-month salary);
- Social – Health – Insurance paid fully. Healthcare: Annual health check-up, Premium Health Insurance (from level senior according to the company's regulations);
- Advantageous and yield benefits, other benefits such as holiday vacations, benefits for employee’s relatives;
- Unlimited chance of being promoted based on employee’s performance.