NFSv 4 1p NFS Commercial Open Solutions Ready

NFSv 4. 1/p. NFS Commercial & Open Solutions “Ready for Prime Time Deployment” February 13 FAST 2013 NFSv 4. 1 and p. NFS product community

Value of NFSv 4. 1 / p. NFS Industry Standard l Secure l Performance and Scale l l Throughput Increased Storage Capacity (p. NFS) Manageable l l Separates namespace (metadata) from data Allows for data movement, tiering, manipulation while providing direct access to the client 2

p. NFS Vendors Status l l l l EMC Net. App Panasas Tonian IBM Microsoft Red. Hat l l l Linux Client Linux Server Ganesha Open-p. NFS. org SNIA

Linux Client l Linux has the first commercial implementation of NFSv 4. 1 client l Client implementation of NFSv 4. 1 and p. NFS Supports all 3 p. NFS layouts l Emphasis on scalability and feature stability l More performance optimisations to come l O_DIRECT over p. NFS available l

Linux Client l Client supported in 2 distributions: Fedora 16/17/18 beta has support for all 3 p. NFS layout types (files, objects, blocks) l Red Hat Enterprise Linux 6. 2 & 6. 3 has support for the files p. NFS client l On track to make p. NFS a GA feature with RHEL 6. 4 l l As part of GA, direct I/O support; big plus for database vendors.

Linux Server l Linux p. NFS project is actively maintained by Tonian. l l l Development tree: git: //linux-nfs. org/projects/bhalevy/linuxpnfs. git http: //wiki. linux-nfs. org/wiki/index. php/PNFS_Development The project includes the reference implementation of the pnfs server for: l files: Exporting GFS 2 and OCFS 2 (DLM based clustered file system) l l supporting parallel I/O for read access objects: Exporting the EXOFS file system. Development appears to be accelerating now that the client is done l Server code to be submitted to the kernel in the coming months l

RHEL 6. 2/6. 3 - p. NFS Client support only l p. NFS file layout l Insert module into kernel l l l Create /etc/modprobe. d/dist-nfs 41. conf Add ‘alias nfs-layouttype 4 -1 nfs_layout_nfsv 41_files‘ Reboot With RHEL 6. 3 above will not be needed Mount the file system with “minorversion” mount option l E. g. mount –o minorversion=1 server: /export /mnt

SLES 11 SP 2 - p. NFS l Client support only l GA early 2013

EMC p. NFS Block Server Status l Support for p. NFS block server since 2010 – first GA product l Next EMC VNX release will include p. NFS server optimized for performance l p. NFS block server performance (from multiple clients with i. SCSI) – 900 MB/sec

EMC p. NFS Block Client Status l EMC support Linux p. NFS block client l New p. NFS block client patches by EMC developers provide optimizations for performance in Linux Kernel 3. 2 p. NFS block client performance over i. SCSI – read-100 MB/sec; write-90 MB/sec

Net. App NFS Support Matrix l Available: ONTAP 8. 1 7. 3. x 8. 1 7 -mode 8. 1 C-Mode NFS v 3 Yes Yes Yes NFS v 4. 0 with Delegations Yes Yes NFS v 4. 0 with Referrals No No Yes NFS v 4. 1 with p. NFS No No Yes NFS v 4. 1 with Referrals No No Yes NFS v 4. 1 with Delegations No No No NFS v 4. 1 with p. NFS and Delegations No No No

Cluster-Mode – Optimized Data Path with p. NFS 1 Meta-data Path 4 3 N-Blade NFS, Network, M-Host Conversion to Spin. NP VLDB/Name Lookup Data Path N-Blade Spin. NP NFS, Network, M-Host Conversion to Spin. NP VLDB/Name Lookup 5 2 Memory Bus D-Blade Network stack, WAFL, Caching Meta-data, Locking Memory Bus Gigabit Cluster interconnect D-Blade Network Stack, WAFL, Caching Meta-data, Locking 3 Storage l l l Storage Direct network path to volume Layout invalidation trigger new network path computation Automatic provisioning Minimum cluster traffic between nodes Faster response time

Panasas to ship p. NFS in 2013 Panasas a founding advocate of p. NFS standards process, has contributed to Linux client & server code, especially object layout code l Panasas systems designed from the ground up, anticipating p. NFS l l True scale-out architecture backed by high-performance Pan. FS file system Today shipping with Direct. Flow, precursor to p. NFS with 8 years of production use p. NFS Objects will be ideal for high throughput applications Linux Compute Nodes Panasas Director Blades p. NFS Client l. NFSv 4. 1 Direct. Flow Client lp. NFSd Server l. Direct. Flow Client l. Panasas lread/write l. RPCs li. SCSI/OSD l. Panasas Metadata Server Panasas Active. Stor lmetadata li. SCSI/OSD

Panasas p. NFS Scaling l Panasas has already demonstrated p. NFS scaling to 128 clients at multiple gigabytes per second

IBM GPFS File-based p. NFS Clients GPFS Servers Linux, AIX, Windows Storage AIX Windows Linux l Fully-symmetric GPFS architecture - scalable data and metadata l l l l p. NFS client can mount and retrieve layout from any GPFS node Metadata requests load balanced across cluster Direct data access from any GPFS server Flexible layout creation Future integration with AFM (Panache) and FPO (SNC) Active development of user-space NFS server (Ganesha) Joined Open-p. NFS

Windows Server 2012 l Base NFSv 4. 1 only l l l Integrated with Windows Failover clustering Identity Mapping Support l l l Passwd/group file mapping Active Directory ADLDS or 3 rd party LDAP stores (RFC 2307 compliant) User name mapping (legacy) RPCSEC_GSS support l l l Mandatory aspects of RFC 5661 Krb 5, Krb 5 i, and Krb 5 p Multiprotocol access (SMB / NFS) to same share Volume Mount Point Support

Tonian Status l Tonian founded in 2010 l Charles River Ventures and Cedar Fund Tonian is developing a p. NFS-based products for the enterprise market l p. NFS Leadership l l Maintainer for kernel based p. NFSd Facilitating open-p. NFS. org Contacts l l CTO: Benny Halevy bhalevy@tonian. com VP Products & Marketing: Doug O’Flaherty douglas@tonian. com

Tonian Update l Clustered enterprise workloads are common l l p. NFS metadata virtualizes data location l l l Virtualization, Cloud, Big Data Transparent to the application With more flexibility Focused on policy-based metadata services l l l Single namespace flexibility Data mobility Dynamic storage allocation based upon application l Products to be announced in 1 H 2013

Update on Layouts in IETF l Tonian extending file and object layout l l l Flexible Files Layout (a. k. a NFS Objects layout) Adds per-file, flexible striping patterns over the NFSv 4. 1 files layout Supports mirroring and advanced RAID striping patterns Supports legacy NFS servers Standalone data servers can be clustered over p. NFS Back-end control protocol is optional l l Can support existing clustered file systems, like Gluster. FS or Ceph. EMC has also submitted a proposal l l p. NFS Lustre Layout Aims at replacing native Lustre clients with standard p. NFS

NFS-Ganesha (1/2) l l l NFS-Ganesha is a user space implementation of a NFSv 2/3/4. x including p. NFS features (starting with FILES_LAYOUT 4) It works on several FS backends : XFS, ZFS, GPFS, LUSTRE, CEPH, HPSS (HSM from IBM Gov). It has a generic VFS backend (based on 2. 6. 39 and later's « open by handle » feature) It can be used as a NFSv 4 proxy It can be used with any FUSE ready product via « FUSELIKE backend » It supports NFSv 4. 0 and NFSv 4. 1/p. NFS

NFS-Ganesha (2/2) l l l The project started in early 2005 at CEA/DAM. It is used in production at CEA/DAM's compute centers In 2009, IBM Joined the community In 2010, Linux Box joined the community In 2011 Panasas joined the community The community is now quite active Want to join ? You're welcome : -) l Useful links: l l http: //nfs-ganesha. sf. net Http: //github. com/phdeniel/nfs-ganesha. git nfs-ganesha-devel@lists. sourceforge. net

NFSv 4 Performance l HEPi. X Working Group report, October 2012 from CERN https: //indico. cern. ch/get. File. py/access? contrib. Id=41&s ession. Id=3&res. Id=1&material. Id=slides&conf. Id=199025 Copyright Andrei Masslenikov, CERN CASPUR/CINECA

Getting Started with NFSv 4. 1/p. NFS l Assist user community as NFSv 4. 1 is tested and deployed l Gather NFSv 4. 1 practical deployment information on a shared web site l E. g. Opensource toolset for evaluation

l l l p. NFS community of industry leaders that support the development and adoption of the p. NFS standard Focused on Use Cases & Applications www. open-pnfs. org

SNIA ESF NFS SIG The SNIA Ethernet Storage Forum (ESF) focuses on educating end-users about Ethernet-connected storage networking technologies l NFS SIG drives adoption and understanding of p. NFS across vendors to constituents l l l Marketing, industry adoption, Open Source updates www. snia. org/forums/es f

Addenda l Windows NFSv 4. 1 Client for Windows l l Fedora 16/17/18 beta l l http: //fedoraproject. org/get-fedora Linux p. NFS Server l l http: //www. citi. umich. edu/projects/nfsv 4/windows/ http: //wiki. linuxnfs. org/wiki/index. php/PNFS_Development Contacts l l l Steve Dickson steved@redhat. com Alex Mc. Donald alexmc@netapp. com Douglas O'Flaherty douglas@tonian. com