d/freebsd-dev
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Fix the memory barriers for CPUs that do not like lwsync and wedge or cause

Browse Source 
exceptions early enough during boot that the kernel will do ithe same.
Use lwsync only when compiling for LP64 and revert to the more proven isync
when compiling for ILP32. Note that in the end (i.e. between revision 222198
and this change) ILP32 changed from using sync to using isync. As per Nathan
the isync is needed to make sure I/O accesses are properly serialized with
locks and isync tends to be more effecient than sync.

While here, undefine __ATOMIC_ACQ and __ATOMIC_REL at the end of the file
so as not to leak their definitions.

Discussed with: nwhitehorn
This commit is contained in:
Marcel Moolenaar 2012-05-24 20:45:44 +00:00
parent 695d8e87f2
commit df0bef25eb
Notes: svn2git 2020-12-20 02:59:44 +00:00 
svn path=/head/; revision=235931
1 changed files with 22 additions and 12 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

34
sys/powerpc/include/atomic.h
View File

@ -36,23 +36,30 @@
#error this file needs sys/cdefs.h as a prerequisite
#endif
/* NOTE: lwsync is equivalent to sync on systems without lwsync */
#define mb() __asm __volatile("lwsync" : : : "memory")
#ifdef __powerpc64__
#define rmb() __asm __volatile("lwsync" : : : "memory")
#define wmb() __asm __volatile("lwsync" : : : "memory")
#else
#define rmb() __asm __volatile("lwsync" : : : "memory")
#define wmb() __asm __volatile("eieio" : : : "memory")
#endif
/*
* The __ATOMIC_REL/ACQ() macros provide memory barriers only in conjunction
* with the atomic lXarx/stXcx. sequences below. See Appendix B.2 of Book II
* of the architecture manual.
* with the atomic lXarx/stXcx. sequences below. They are not exposed outside
* of this file. See also Appendix B.2 of Book II of the architecture manual.
*
* Note that not all Book-E processors accept the light-weight sync variant.
* In particular, early models of E500 cores are known to wedge. Bank on all
* 64-bit capable CPUs to accept lwsync properly and pressimize 32-bit CPUs
* to use the heavier-weight sync.
*/
#ifdef __powerpc64__
#define mb() __asm __volatile("lwsync" : : : "memory")
#define rmb() __asm __volatile("lwsync" : : : "memory")
#define wmb() __asm __volatile("lwsync" : : : "memory")
#define __ATOMIC_REL() __asm __volatile("lwsync" : : : "memory")
#define __ATOMIC_ACQ() __asm __volatile("lwsync" : : : "memory")
#else
#define mb() __asm __volatile("isync" : : : "memory")
#define rmb() __asm __volatile("isync" : : : "memory")
#define wmb() __asm __volatile("isync" : : : "memory")
#define __ATOMIC_REL() __asm __volatile("isync" : : : "memory")
#define __ATOMIC_ACQ() __asm __volatile("isync" : : : "memory")
#endif
/*
* atomic_add(p, v)
@ -683,4 +690,7 @@ atomic_fetchadd_long(volatile u_long *p, u_long v)
#define atomic_fetchadd_64 atomic_fetchadd_long
#endif
#undef __ATOMIC_REL
#undef __ATOMIC_ACQ
#endif /* ! _MACHINE_ATOMIC_H_ */