Pagination at the datasource level

Yes, if it is supported, e.g. Loki:

But MySQL datasource doesn’t have this kind of feature implemented.