Yes. You can choose to publish the form as a Floating Button. From the Publish section – Embed Code – Lightbox.
Afterwards, you can customize your button by selecting the text you want displayed, the background color and whether you want the button to be placed on the left side or the right side of your window.
Copy the code that was generated so you can paste it on your website.