Yes, there is still a database layer (Azure SQL or SQL Server), an application server (web application) and a client (browser).
On-premises deployments are hosted in Service Fabric clusters; you're wrong in thinking that these are two separate deployment options.