Several significant changes in the diagnostic criteria for gambling disorder occurred with the newest revision of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5). The changes aim to simplify and streamline the diagnosis without compromising its validity. Yet many of the tools used to screen and diagnose the disorder are based upon the prior fourth edition of the DSM, and it is unclear how they perform with the revised diagnostic criteria. The aim of this study is to examine the psychometric properties of a common pathological gambling screen, the Brief Biosocial Gambling Screen (BBGS; Gebauer, LaBrie, & Shaffer, 2010), in the context of DSM-5 criteria within a help-seeking sample. Gamblers calling a helpline (N = 2750) completed a semi-structured interview assessing DSM-IV past-year pathological gambling criteria with a trained clinician. Sensitivity, specificity, positive predictive value, negative predictive value and differences by sex were examined. The BBGS had high sensitivity as well as positive and negative predictive values. In light of the revisions made to the diagnostic criteria in DSM-5, the BBGS remains a psychometrically supported instrument for gambling disorder.