Then where does the knowledge come from

A parameter is just one number. But one number, by itself, cannot account for an answer, nor can one number contain a fact such as:

France → Paris

Apparently, billions of parameters are involved.

Not billions of facts, answers or rules.

Just billions of numbers.

And somehow, the correct answer emerges.

The next question How did all those parameters arrive at the correct answer?