Horizontal sound localization in free field requires integration of interaural time (ITD) and level (ILD) differences, in making accurate spatial judgments. Recently, we showed that listeners demonstrated great variability in localizing a stereo sound source (Montagne and Zhou, JASA, 2016). We hypothesized that this variability might arise from conflicting sidedness between ITDs and ILDs within and/or across frequency bands. To test this hypothesis, here we generated a new set of stimuli with variable spatial congruence between ITDs and ILDs by adding a constant inter-channel level cue ( + /- 5 dB) either aligned with or opposed to the inter-channel timing cue (from -1 to 1 msec). In Experiment 1 listeners responded to 15-ms broadband noise bursts. Response variability decreased when the inter-channel timing and level cues were spatially congruent and increased when they were not. In Experiment 2 listeners responded to low- and high-pass filtered noise (1.5 kHz cutoff) for the spatially incongruent stimuli only. Response variability was much reduced but the perceived source location consistently pointed to the “wrong side,” favoring the level cue. Together, the new results suggest a significant weighting role for ILDs (generated from level-based stereophony) in determining the lateral position of a stereo image.