Verify you have 2 ethernet cables connected this way:

1st cable: ISP modem to WAN of ATA
2nd cable: ATA LAN to WAN of Router

Enter your router web configuration and verify the Internet (WAN port) is set to DHCP. Reboot all devices again and verify if you can access the Internet.