Bug 1972176

Summary:	gnome-remote-desktop crashes under FIPS
Product:	Red Hat Enterprise Linux 8	Reporter:	Ondrej Holy <oholy>
Component:	gnome-remote-desktop	Assignee:	Jonas Ådahl <jadahl>
Status:	CLOSED WONTFIX	QA Contact:	Desktop QE <desktop-qa-list>
Severity:	medium	Docs Contact:
Priority:	medium
Version:	8.3	CC:	alanm, amike, brclark, casantos, desktop-qa-list, jwright, mkolbas, sbarcomb
Target Milestone:	beta	Keywords:	Triaged
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:	1960705	Environment:
Last Closed:	2022-12-15 07:30:46 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1960705
Bug Blocks:

Description Ondrej Holy 2021-06-15 11:55:46 UTC

gnome-remote-desktop-daemon crashes under the FIPS mode when establishing the connection:

Process 7059 (gnome-remote-de) of user 1000 dumped core. 
Stack trace of thread 7059:
#0  0x00007f23a536d1f4 __gmpz_sizeinbase (libgmp.so.10)
#1  0x00007f23a8dade72 wrap_nettle_mpi_get_nbits (libgnutls.so.30)
#2  0x00007f23a8cc7bd8 gnutls_anon_set_server_dh_params (libgnutls.so.30)
#3  0x000055a39358799c ensure_tls_context (gnome-remote-desktop-daemon)
#4  0x000055a393587ac5 rfb_tls_security_handler (gnome-remote-desktop-daemon)
#5  0x00007f23a94c3348 rfbProcessClientSecurityType (libvncserver.so.0)
#6  0x00007f23a94be435 rfbProcessClientMessage (libvncserver.so.0)
#7  0x00007f23a94c5020 rfbCheckFds (libvncserver.so.0)
#8  0x00007f23a94bb84b rfbProcessEvents (libvncserver.so.0)
#9  0x000055a39357fbfb vnc_socket_grab_func (gnome-remote-desktop-daemon)
#10 0x000055a393580715 grd_session_vnc_dispatch (gnome-remote-desktop-daemon)
#11 0x000055a3935807d2 handle_socket_data (gnome-remote-desktop-daemon)
#12 0x00007f23a9c8bccd socket_source_dispatch (libgio-2.0.so.0)
#13 0x00007f23a9fff8ad g_main_context_dispatch (libglib-2.0.so.0)
#14 0x00007f23a9fffc78 g_main_context_iterate.isra.21 (libglib-2.0.so.0)
#15 0x00007f23a9fffd10 g_main_context_iteration (libglib-2.0.so.0)
#16 0x00007f23a9cb210d g_application_run (libgio-2.0.so.0)
#17 0x000055a393575c57 main (gnome-remote-desktop-daemon)
#18 0x00007f23a86a4493 __libc_start_main (libc.so.6)
#19 0x000055a393575d5e _start (gnome-remote-desktop-daemon)

This is because DH_BITS is 1024, which too small for FIPS. It causes that gnutls_dh_params_generate2 returns 0 and consequently gnutls_anon_set_server_dh_params crashes because of that. TigerVNC uses the following patch for some time already, see http://pkgs.devel.redhat.com/cgit/rpms/tigervnc/tree/tigervnc-working-tls-on-fips-systems.patch?h=rhel-9.0.0-beta. I am going to fix that for vino right now, see Bug 1960705. So it would be nice to fix this for gnome-remote-desktop as well...

Comment 3 RHEL Program Management 2022-12-15 07:30:46 UTC

After evaluating this issue, there are no plans to address it further or fix it in an upcoming release.  Therefore, it is being closed.  If plans change such that this issue will be fixed in an upcoming release, then the bug can be reopened.