Can I move the magic edit button?

Yes, you can.  Simply right click the extension icon in the Chrome toolbar (look for the wizard hat and wand).  Then go to the options menu and there is a setting to move it to one of four locations or completely hide it (then only the chrome toolbar button will edit).