>Desktop app is about 4 times faster than the Web app (server overhead), GUI is much rougher (see attached)

As you often take the time to measure exactly, did you measure which parts slowed down to what percentage or try out running the browser on the machine working as server ?