summaryrefslogtreecommitdiff
path: root/include/drm
diff options
context:
space:
mode:
authorGerd Hoffmann <kraxel@redhat.com>2018-09-05 09:04:43 +0300
committerGerd Hoffmann <kraxel@redhat.com>2018-09-06 09:40:19 +0300
commit6960e6da9cec3f6638121527c728305827ec12ab (patch)
treef962fb5c76fe4059b8129fbebdb347226b378093 /include/drm
parent00409fd6f14f1a3f06c6ea50a6f2fba17c5573d9 (diff)
downloadlinux-6960e6da9cec3f6638121527c728305827ec12ab.tar.xz
drm: fix drm_mode_addfb() on big endian machines.
Userspace on big endian machhines typically expects the ADDFB ioctl returns a big endian framebuffer. drm_mode_addfb() will call drm_mode_addfb2() unconditionally with little endian DRM_FORMAT_* values though, which is wrong. This patch fixes that. Drivers (both kernel and xorg) have quirks in place to deal with the broken drm_mode_addfb() behavior. Because of this we can't just change drm_mode_addfb() behavior for everybody without breaking things. Add the quirk_addfb_prefer_host_byte_order field to mode_config, so drivers can opt-in. Signed-off-by: Gerd Hoffmann <kraxel@redhat.com> Reviewed-by: Daniel Vetter <daniel.vetter@ffwll.ch> Link: http://patchwork.freedesktop.org/patch/msgid/20180905060445.15008-5-kraxel@redhat.com
Diffstat (limited to 'include/drm')
-rw-r--r--include/drm/drm_mode_config.h14
1 files changed, 14 insertions, 0 deletions
diff --git a/include/drm/drm_mode_config.h b/include/drm/drm_mode_config.h
index 5d29f4ba6f69..928e4172a0bb 100644
--- a/include/drm/drm_mode_config.h
+++ b/include/drm/drm_mode_config.h
@@ -812,6 +812,20 @@ struct drm_mode_config {
bool quirk_addfb_prefer_xbgr_30bpp;
/**
+ * @quirk_addfb_prefer_host_byte_order:
+ *
+ * When set to true drm_mode_addfb() will pick host byte order
+ * pixel_format when calling drm_mode_addfb2(). This is how
+ * drm_mode_addfb() should have worked from day one. It
+ * didn't though, so we ended up with quirks in both kernel
+ * and userspace drivers to deal with the broken behavior.
+ * Simply fixing drm_mode_addfb() unconditionally would break
+ * these drivers, so add a quirk bit here to allow drivers
+ * opt-in.
+ */
+ bool quirk_addfb_prefer_host_byte_order;
+
+ /**
* @async_page_flip: Does this device support async flips on the primary
* plane?
*/