The answer to their question was in front of their eyes all along. Here are the chief priests, the scribes, and these leading Pharisees or their representatives; and here is the coin held up for all to see.
God has ordained civil government (Romans 13:1; 1 Peter 2:13). We are very often opposed to it. We may not like it, but it is an institution of God. Scripture teaches that. All men are placed by God under civil government: for law enforcement, for order, for things that keep communities safe and sound and together. So we owe them.