A growing proportion of head and neck cancer (HNC), especially oropharyngeal cancer (OPC), is caused by human papillomavirus (HPV). There are several markers for HPV-driven HNC, one being HPV early antigen serology. We aimed to investigate the diagnostic accuracy of HPV serology and its performance across patient characteristics. Data from the VOYAGER consortium was used, which comprises five studies on HNC from North America and Europe. Diagnostic accuracy, that is, sensitivity, specificity, Cohen's kappa and correctly classified proportions of HPV16 E6 serology, was assessed for OPC and other HNC using p16INK4a immunohistochemistry (p16), HPV in situ hybridization (ISH) and HPV PCR as reference methods. Stratified analyses were performed for variables including age, sex, smoking and alcohol use, to test the robustness of diagnostic accuracy. A risk-factor analysis based on serology was conducted, comparing HPV-driven to non-HPV-driven OPC. Overall, HPV serology had a sensitivity of 86.8% (95% CI 85.1-88.3) and specificity of 91.2% (95% CI 88.6-93.4) for HPV-driven OPC using p16 as a reference method. In stratified analyses, diagnostic accuracy remained consistent across sex and different age groups. Sensitivity was lower for heavy smokers (77.7%), OPC without lymph node involvement (74.4%) and the ARCAGE study (66.7%), while specificity decreased for cases with <10 pack-years (72.1%). The risk-factor model included study, year of diagnosis, age, sex, BMI, alcohol use, pack-years, TNM-T and TNM-N stage. HPV serology is a robust biomarker for HPV-driven OPC, and its diagnostic accuracy is independent of age and sex. Future research is suggested on the influence of smoking on HPV antibody levels.