imx_gpio: enable only the transport specific gpio