Bug 1326918 - The Samba RPC server fails to verify trailers of clients which support header signing
Summary: The Samba RPC server fails to verify trailers of clients which support header...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 5
Classification: Red Hat
Component: samba3x
Version: 5.11
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: rc
: ---
Assignee: Guenther Deschner
QA Contact: Robin Hack
URL:
Whiteboard:
Depends On:
Blocks: 1328909
TreeView+ depends on / blocked
 
Reported: 2016-04-13 18:36 UTC by Bryan
Modified: 2023-05-15 13:29 UTC (History)
37 users (show)

Fixed In Version: samba3x-3.6.23-13.el5_11
Doc Type: Bug Fix
Doc Text:
Clone Of:
: 1328909 (view as bug list)
Environment:
Last Closed: 2016-06-23 13:14:12 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
log file (working, 3.6.23-25.el6_7) (674.99 KB, text/plain)
2016-04-14 14:18 UTC, Pierre Ossman
no flags Details
log file (failing, 3.6.23-30.el6_7) (366.86 KB, text/plain)
2016-04-14 14:19 UTC, Pierre Ossman
no flags Details
smb.conf of the PDC (2.43 KB, text/plain)
2016-04-14 14:57 UTC, Daniel B
no flags Details
Log file during a successful login (3.6.23-9.el5_11) (35.43 KB, text/plain)
2016-04-14 14:57 UTC, Daniel B
no flags Details
Log file during a failed login (3.6.23-12.el5_11) (25.98 KB, text/plain)
2016-04-14 14:58 UTC, Daniel B
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Debian BTS 820981 0 None None None 2016-04-22 09:51:31 UTC
Red Hat Product Errata RHBA-2016:1294 0 normal SHIPPED_LIVE samba3x bug fix update 2016-06-23 17:12:19 UTC

Description Bryan 2016-04-13 18:36:09 UTC
Description of problem:
When updating to the latest samba updates:

latest samba updates:

===
=== yum reports available updates:
===

libsmbclient.i386                    3.0.33-3.41.el5_11                  updates
samba3x.i386                         3.6.23-12.el5_11                    updates
samba3x-client.i386                 3.6.23-12.el5_11                    updates
samba3x-common.i386            3.6.23-12.el5_11                    updates
samba3x-winbind.i386             3.6.23-12.el5_11                    updates

ALL prior required updates have been performed prior to these.

This also comes after a Windows update. However, 2 PCs, one Win7 the other Windows 10, joined the domain and were able to login prior to the update. However, after the update neither Windows 7 or Windows 10 clients can log into the SME 8.2 Server as there is a NT_STATUS_TRUSTED_RELATIONSHIP_FAILURE during attempted login.

I've removed the client by force from the domain and added them back onto the domain and still I get this same error.

Rebooted the server and client PCs and still the same error.

I even performed a yum downgrade to remove these updates and I still see the same trust relationship failure error.

Version-Release number of selected component (if applicable):
All

How reproducible:
replicated on EVERY PC accessing the domain

Steps to Reproduce:
1.reboot
2.login
3.error given = TRUST RELATIONSHIP FAILURE

Actual results:
TRUST RELATIONSHIP FAILURE

Expected results:
Log into domain

Additional info:
in the Messages file I see the following format for multiple users:
Apr 13 09:49:12 icarus smbd[12805]: [2016/04/13 09:49:12.254867,  0] rpc_server/netlogon/srv_netlog_nt.c:976(_netr_ServerAuthenticate3)
Apr 13 09:49:12 icarus smbd[12805]:   _netr_ServerAuthenticate3: netlogon_creds_server_check failed. Rejecting auth request from client PC3 machine account PC3$

and still continues for each user logged into the domain

Comment 2 Daniel B 2016-04-13 20:26:44 UTC
This bug should be against RHEL5. When running as an NT4 domain controller, last samba3x updates (RHSA-2016-0613) break trust relationship. Affects at least Windows 7 and Windows Server 2012R2 clients.
The very same issue also affects RHEL6 (after applying updates from RHSA-2016-0611)
In both cases, downgrading the various samba3x/samba packages makes everything working again

Comment 3 Bryan 2016-04-13 20:32:56 UTC
Sorry Daniel, wrong release. I downgraded but nothing has changed. Can you please give me the steps to downgrade?
Thanks,
B

Comment 4 Andreas Schneider 2016-04-14 05:57:07 UTC
Please provide log files with a higher log level. If I understand it correctly you have a Samba server running as a primary domain controller and Windows clients are joined to it.

Please read https://www.samba.org/~asn/reporting_samba_bugs.txt it will explain how to provide the information we need and find it quickly. See the info about the 'date' command.

Comment 5 Bryan 2016-04-14 14:07:25 UTC
Andreas,
I found a method to downgrade and roll back to the prior version and which fixed this issue.
The command I used:
yum downgrade samba\* libsmbclient

Workstations and other Microsoft servers can now properly interact with the domain.
Thanks,
Bryan

Comment 6 Pierre Ossman 2016-04-14 14:17:38 UTC
We are also seeing this (on RHEL 6) after the upgrade. Downgrading helps. Versions of packages:

libtevent-0.9.26-2.el6_7.x86_64
samba-common-3.6.23-30.el6_7.x86_64
samba4-libs-4.2.10-6.el6_7.x86_64
libtdb-1.3.8-1.el6_7.x86_64
samba-winbind-clients-3.6.23-30.el6_7.x86_64
samba-3.6.23-30.el6_7.x86_64
tdb-tools-1.3.8-1.el6_7.x86_64
samba-client-3.6.23-30.el6_7.x86_64
libtalloc-2.1.5-1.el6_7.x86_64
libldb-1.1.25-2.el6_7.x86_64
pytalloc-2.1.5-1.el6_7.x86_64
samba-winbind-3.6.23-30.el6_7.x86_64

I did a run with the latest samba and the previous one (failing and working) with the logging turned up. I'll attach the files next, but I can point out this suspicious difference in the logs:

> [2016/04/14 15:56:46.986588, 10] ../librpc/rpc/dcerpc_util.c:606(dcerpc_sec_verification_trailer_check)
>   SEC_VT check Bitmask1 client_header_signing failed

Comment 7 Pierre Ossman 2016-04-14 14:18:39 UTC
Created attachment 1147264 [details]
log file (working, 3.6.23-25.el6_7)

Comment 8 Pierre Ossman 2016-04-14 14:19:07 UTC
Created attachment 1147265 [details]
log file (failing, 3.6.23-30.el6_7)

Comment 9 Pierre Ossman 2016-04-14 14:21:23 UTC
The test case here is a RHEL 6 acting as a NT4 DC for a Windows 2008R2 machine. From a Fedora 23 machine I used smbclient to connect to the Windows machine:

> $ smbclient //tezava/C$
> Enter ossman's password: 
> session setup failed: NT_STATUS_TRUSTED_RELATIONSHIP_FAILURE

(same problem occurs for any user authentication, but this was a simple command line test case)

Comment 10 Daniel B 2016-04-14 14:56:19 UTC
Ok, so here are some more complete information for how to reproduce the problem.

Have a samba3x server running as a PDC, with windows stations joined on the domain


[root@el5 ~]# rpm -qa samba\* \*smb\* \*talloc\* \*tdb\* \*ldb\* \*tevent\* \*wbclient\*
libtevent-0.9.18-2.el5
samba3x-client-3.6.23-9.el5_11
samba3x-common-3.6.23-9.el5_11
libtalloc-2.0.7-2.el5
hsqldb-1.8.0.9-1jpp.3
samba3x-winbind-3.6.23-9.el5_11
libtdb-1.2.10-1.el5
samba3x-3.6.23-9.el5_11
tdb-tools-1.2.10-1.el5
libsmbclient-3.0.33-3.40.el5_10
[root@el5 ~]# 

See the attached smb.conf file for the relevant sections of my config (I just removed my shares definition as it most likely is not relevant)

One client is member of the NT4 domain. It's a Windows 7 pro box (name: win7, IP: 192.168.7.12)

I can log into this box with no problem, see the win7_ok.log file, which traces a successful login from this box using a domain account.

I now update the different packages:

yum update samba\* libsmb\*

Full transaction:

Updating:
 libsmbclient                                           i386                                        3.0.33-3.41.el5_11
 samba3x                                                i386                                        3.6.23-12.el5_11  
 samba3x-client                                         i386                                        3.6.23-12.el5_11  
 samba3x-common                                         i386                                        3.6.23-12.el5_11  
 samba3x-winbind                                        i386                                        3.6.23-12.el5_11  

Now:

[root@el5 ~]# rpm -qa samba\* \*smb\* \*talloc\* \*tdb\* \*ldb\* \*tevent\* \*wbclient\*
libtevent-0.9.18-2.el5
samba3x-client-3.6.23-12.el5_11
samba3x-winbind-3.6.23-12.el5_11
libtalloc-2.0.7-2.el5
hsqldb-1.8.0.9-1jpp.3
libsmbclient-3.0.33-3.41.el5_11
samba3x-3.6.23-12.el5_11
libtdb-1.2.10-1.el5
tdb-tools-1.2.10-1.el5
samba3x-common-3.6.23-12.el5_11
[root@el5 ~]#

After restarting the smbd daemon, I can no longer open a session using a domain account. On the client computer, I get a message stating that the trust relationship between this station and the domain failed (the exacte message in french is "La relation d'approbation entre cette station de travail et le domaine a échoué.")

See the file win7_ko.log for the server-side logs when I try to login.

Comment 11 Daniel B 2016-04-14 14:57:07 UTC
Created attachment 1147271 [details]
smb.conf of the PDC

Comment 12 Daniel B 2016-04-14 14:57:53 UTC
Created attachment 1147272 [details]
Log file during a successful login (3.6.23-9.el5_11)

Comment 13 Daniel B 2016-04-14 14:58:23 UTC
Created attachment 1147273 [details]
Log file during a failed login (3.6.23-12.el5_11)

Comment 14 Bryan 2016-04-14 15:13:06 UTC
here is my samba configuration file as well. 

[global]

add machine script = /sbin/e-smith/signal-event machine-account-create '%u'

bind interfaces only = yes

case sensitive = no
deadtime = 10080

display charset = ISO8859-1

dns proxy = no

domain logons = yes
domain master = yes
dos charset = 850

encrypt passwords = yes

guest account = public

guest ok = no
hosts allow = 127.0.0.1 192.168.1.0/255.255.255.0 192.168.2.0/255.255.255.0 192.168.3.0/255.255.255.0 192.168.4.0/255.255.255.0 192.168.9.0/255.255.255.0

interfaces = 127.0.0.1 192.168.1.16/255.255.255.0

log file = /var/log/samba/log.%m
logon drive = Z:

logon path =
logon script = netlogon.bat

map to guest = never

max log size = 50

name resolve order = wins lmhosts bcast

netbios name = icarus
oplocks = true
kernel oplocks = true
level2 oplocks = true

os level = 65
passdb backend = smbpasswd:/etc/samba/smbpasswd

pid directory = /var/run
preferred master = yes

preserve case = yes
private dir = /etc/samba

security = user
server string = SME Server
short preserve case = yes
smb passwd file = /etc/samba/smbpasswd
smb ports = 139

socket options = TCP_NODELAY

strict locking = no
unix charset = UTF8
unix password sync = Yes
pam password change = Yes

passwd program = /usr/bin/passwd %u

Comment 15 Bryan 2016-04-14 15:15:05 UTC
(In reply to Bryan from comment #14)
> here is my samba configuration file as well. 

This was prior to the downgrade from (3.6.23-9.el5_11)

Comment 16 Guenther Deschner 2016-04-14 16:01:32 UTC
Ok, thanks for the data. I can reproduce it here.

Comment 17 Alan 2016-04-14 18:51:58 UTC
I've confirmed that this also affects RHEL7 clients (Samba 4.2) where I get either a NT_STATUS_CANT_ACCESS_DOMAIN_INFO reply or an NT_STATUS_ACCESS_DENIED when trying to connect to a RHEL6 PDC.

On the samba 3.6 PDC logs I see a:
"Rejecting auth request from client"
Which seems to indicate that there is a problem with the machine user account entry.  Deleting the machine account and trying to re-create it also fails (the machine account is created but "net rpc join" fails).  The PDC will also frequently set the flags of the machine account to Disabled, which I then have to manually unset.

I was also unable to connect from other RHEL6 clients until I added:
server signing = auto
to the smb.conf, which fixed that but did not fix connections from samba 4.2
I also tried all of the following to no avail:
raw NTLMv2 auth = yes
allow dcerpc auth level connect = yes
client ipc signing = auto
client signing = auto
server min protocol = LANMAN1

Rolling the PDC back from 3.6.23-30 to 3.6.23-25 completely fixed the problem.

I should note that samba 4.2 was able to accurately retrieve domain info:
net rpc info
but wasn't able to join the domain.
-alan

Comment 18 Andreas Schneider 2016-04-15 16:26:04 UTC
We identified the issue and have a working fix.

Comment 19 siewzx 2016-04-18 03:14:54 UTC
Anyone got working fix?

Me and my user all cant login to our domain.

Comment 20 Bryan 2016-04-18 13:07:09 UTC
All, 
If you are using Win 7 or Win 10, just unplug the network cable (or disable WiFi) then login. It's similar to a local login (versus a network login). Once you've logged in you can re-plug in the network cable and use your resources as normal. Also, turn off the sleep mode with password required so you're not forced to log back in each time your system goes to sleep.
-Bryan

Comment 21 Andreas Schneider 2016-04-19 05:52:27 UTC
If you require a hotfix until we are able to roll out an update please talk to your Red Hat support contact!

Comment 22 Martin 2016-04-19 08:15:31 UTC
(In reply to Andreas Schneider from comment #21)
> If you require a hotfix until we are able to roll out an update please talk
> to your Red Hat support contact!

Are there any plans when this is going to be rolled out already? (A rough estimate would be enough, e.g. in two weeks, in a month...)

Comment 24 Andreas Schneider 2016-04-20 15:36:32 UTC
I have a fix for the issue. Sorting out how to do updates for all released versions.

Comment 26 Oliver Schulze L. 2016-04-30 15:11:26 UTC
I was affected too, my command for downgrade was:

yum downgrade samba3x samba3x-common samba3x-client samba3x-swat samba3x-winbind

I'm on RHEL 5.11 with samba NT4 style, mixed WinXP and Win7 clients.

After downgrade, the clients can login instantly, no reboot necessary.

Comment 27 elhefe 2016-05-12 10:54:22 UTC
(In reply to Martin from comment #22)
> (In reply to Andreas Schneider from comment #21)
> > If you require a hotfix until we are able to roll out an update please talk
> > to your Red Hat support contact!
> 
> Are there any plans when this is going to be rolled out already? (A rough
> estimate would be enough, e.g. in two weeks, in a month...)

I also would like to know a rough estimate about the release date of this fix...

Comment 28 Colin.Simpson 2016-05-12 15:53:58 UTC
Is this the same as the RHEL 6 Bug#1327697 ?

Comment 29 Charlie Brady 2016-05-18 14:22:41 UTC
(In reply to elhefe from comment #27)
 
> I also would like to know a rough estimate about the release date of this
> fix...

Maybe some time this year... :-)

Comment 30 Martin 2016-05-31 09:18:40 UTC
(In reply to Charlie Brady from comment #29)
> (In reply to elhefe from comment #27)
>  
> > I also would like to know a rough estimate about the release date of this
> > fix...
> 
> Maybe some time this year... :-)

Interestingly this seems to haven been fixed for RHEL 6 only the RHEL 5 updates seems to take a while.

Comment 31 Michael Starling 2016-05-31 20:08:04 UTC
(In reply to Martin from comment #30)

> Interestingly this seems to haven been fixed for RHEL 6 only the RHEL 5
> updates seems to take a while.


I'm still having the same issue with 3.6.23-35.el6_8 and there's nothing in the change log that would indicate this is fixed on RHEL6. How are you verifying a fix has been implemented?

Comment 34 Martin 2016-06-03 09:19:09 UTC
(In reply to Michael Starling from comment #31)
> (In reply to Martin from comment #30)
> 
> > Interestingly this seems to haven been fixed for RHEL 6 only the RHEL 5
> > updates seems to take a while.
> 
> 
> I'm still having the same issue with 3.6.23-35.el6_8 and there's nothing in
> the change log that would indicate this is fixed on RHEL6. How are you
> verifying a fix has been implemented?

Strange, the version you mentioned is working for me. Also see the here:
https://rhn.redhat.com/errata/RHBA-2016-0992.html

Comment 35 dondan 2016-06-15 07:25:16 UTC
@Michael Starling: Same here 3.6.23-35.el6 does not solve the problem. I think we have to wait or upgrade to Rhel7 to get rid of the problem.

Comment 36 Andreas Schneider 2016-06-15 15:04:40 UTC
If you have regressions in RHEL6 please report them and do not capture other bugs. Thanks!

Comment 37 Michael Starling 2016-06-15 17:31:59 UTC
Andreas, I originally reported this for RHEL 6 and opened a case with Red Hat in the first week of April. They then opened a separate bugzilla for RHEL 6 but you marked the bug as a duplicate, closed it and attached attached my case to this bug.

https://bugzilla.redhat.com/show_bug.cgi?id=1328909



I'm still able to join Windows systems to my NT domain but they are unable to authenticate. This isn't a new bug but it's the same issue that's been manifesting itself all along.

Comment 38 Michael Starling 2016-06-16 01:51:04 UTC
Update:

For anyone else on this mailing list still having issues with RHEl6.

After some more reading and troubleshooting I was able to fix domain logons by disabling TCP Chimney Offload in Windows

Comment 39 Andreas Schneider 2016-06-16 06:42:26 UTC
I've added the wrong bug id. I fixed it.

Comment 40 Maurizio Marini 2016-06-16 07:33:28 UTC
when is it planned to be released samba3x-3.6.23-13.el5_11, roughly?

Comment 42 Charlie Brady 2016-06-16 13:33:36 UTC
(In reply to Maurizio Marini from comment #40)

> when is it planned to be released samba3x-3.6.23-13.el5_11, roughly?

IMO this should have "security" priority classification, since the regression is preventing the implementation of a critical security update for many users:

https://rhn.redhat.com/errata/RHSA-2016-0613.html

A response > 2 months is pretty disappointing.

Comment 43 Maurizio Marini 2016-06-17 20:14:21 UTC
thanks to Andreas patch 
https://git.samba.org/?p=asn/samba.git;a=commitdiff;h=82fa625540abf8b8ec23d43c41e2ca906a9928a5;hp=ea6f2386611d0a4edd65962a59b3448be976c1bb

I was able to fix samba3x-3.6.23-12.el5_11.src.rpm and users on win7 clients are able to login again, nevertheless I wait for officially released package

Comment 46 errata-xmlrpc 2016-06-23 13:14:12 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1294


Note You need to log in before you can comment on or make changes to this bug.