O'Reilly struck twice, with Erling Haaland providing the assist for his second goal, to secure the win after Lewis Hall had equalized for Newcastle.
The victory keeps City's title challenge alive as they continue to chase Arsenal at the top of the table.