Leviticus 16:10

10But the goat on which the lot fell to be the scape-goat, shall be presented alive before the LORD, to make an atonement with him, [and] to let him go for a scape-goat into the wilderness.