Hi Ravi! It sounds like either the Linux Node integration or Nginx Integration might be a good way to start. Both support sending logs using Grafana Agent to Grafana Cloud.
You mentioned installing the agent binary, but the recommended install method is using the Integrations and Connections walkthrough in your hosted Grafana.
Otherwise, you can check out the other supported clients and methods for shipping logs here.