TEST_UTIL

Section: test_util 1.8 (3)
Updated: 19 July 2021
Index Return to Main Contents
 

NAME

nfstest.test_util - Test utilities module  

DESCRIPTION

Provides a set of tools for testing either the NFS client or the NFS server, most of the functionality is focused mainly on testing the client. These tools include the following:


    - Process command line arguments
    - Provide functionality for PASS/FAIL
    - Provide test grouping functionality
    - Provide multiple client support
    - Logging mechanism
    - Debug info control
    - Mount/Unmount control
    - Create files/directories
    - Provide mechanism to start a packet trace
    - Provide mechanism to simulate a network partition
    - Support for pNFS testing

In order to use some of the functionality available, the user id in all the client hosts must have access to run commands as root using the 'sudo' command without the need for a password, this includes the host where the test is being executed. This is used to run commands like 'mount' and 'umount'. Furthermore, the user id must be able to ssh to remote hosts without the need for a password if test requires the use of multiple clients.

Network partition is simulated by the use of 'iptables', please be advised that after every test run the iptables is flushed and reset so any rules previously setup will be lost. Currently, there is no mechanism to restore the iptables rules to their original state.  

CLASSES

 

class TestUtil(nfstest.nfs_util.NFSUtil)

TestUtil object

TestUtil() -> New server object

Usage:
    x = TestUtil()

    # Process command line options
    x.scan_options()

    # Start packet trace using tcpdump
    x.trace_start()

    # Mount volume
    x.mount()

    # Create file
    x.create_file()

    # Unmount volume
    x.umount()

    # Stop packet trace
    x.trace_stop()

    # Exit script
    x.exit()


Methods defined here:
---------------------

__del__(self)
Destructor

Gracefully stop the packet trace, cleanup files, unmount volume,
and reset network.

__init__(self, **kwargs)
Constructor

Initialize object's private data.

sid:
Test script ID [default: ''] This is used to have options targeted for a given ID without including these options in any other test script.
usage:
Usage string [default: '']
testnames:
List of test names [default: []] When this list is not empty, the --runtest option is enabled and test scripts should use the run_tests() method to run all the tests. Test script should have methods named as <testname>_test.
testgroups:
Dictionary of test groups where the key is the name of the test group and its value is a dictionary having the following keys: tests: A list of tests belonging to this test group desc: Description of the test group, this is displayed in the help if the name of the test group is also included in testnames tincl: Include a comma separated list of tests belonging to this test group to the description [default: False] wrap: Reformat the description so it fits in lines no more than the width given. The description is not formatted for a value of zero [default: 72]
Example: x = TestUtil(testnames=['basic', 'lock']) # The following methods should exist: x.basic_test() x.lock_test()
cleanup(self) Clean up test environment. Remove any files created: test files, trace files. close_files(self, *fdlist) Close all files opened by open_files() and all file descriptors given as arguments. compare_data(self, data, offset=0, pattern=None, nlen=32, fd=None, msg='') Compare data to the given pattern and return a three item tuple: absolute offset where data differs from pattern, sample data at diff offset, and the expected data at diff offset according to pattern. If data matches exactly it returns (None, None, None).
data:
Data to compare against the pattern
offset:
Absolute offset to get the expected data from pattern [default: 0]
pattern:
Data pattern function or string. If this is a function, it must take offset and size as positional arguments. If given as a string, the pattern repeats over and over starting at offset = 0 [default: self.data_pattern]
nlen:
Size of sample data to return if a difference is found [default: 32]
fd:
Opened file descriptor for the data, this is used where the data comes from a file and a difference is found right at the end of the given data. In this case, the data is read from the file to return the sample diff of size given by nlen [default: None]
msg:
Message to append to debug message if a difference is found. If set to None, debug messages are not displayed [default: '']
compare_mount_args(self, mtopts1, mtopts2) Compare mount arguments config(self, msg) Display config message and terminate test with an exit value of 2. create_dir(self, dir=None, mode=493) Create a directory under the given directory with the given mode. create_file(self, offset=0, size=None, dir=None, mode=None, **kwds) Create a file starting to write at given offset with total size of written data given by the size option.
offset:
File offset where data will be written to [default: 0]
size:
Total number of bytes to write [default: --filesize option]
dir:
Create file under this directory
mode:
File permissions [default: use default OS permissions]
pattern:
Data pattern to write to the file [default: data_pattern default]
ftype:
File type to create [default: FTYPE_FILE]
hole_list:
List of offsets where each hole is located [default: None]
hole_size:
Size of each hole [default: --wsize option]
verbose:
Verbosity level [default: 0]
dlevels:
Debug level list to use [default: ["DBG3", "DBG4", "DBG5"]]
Returns the file name created, the file name is also stored in the object attribute filename -- attribute absfile is also available as the absolute path of the file just created. File created is removed at cleanup.
create_rexec(self, servername=None, **kwds) Create remote server object. data_pattern(self, offset, size, pattern=None) Return data pattern.
offset:
Starting offset of pattern
size:
Size of data to return
pattern:
Data pattern to return, default is of the form: hex_offset(0x%08X) abcdefghijklmnopqrst
delay_io(self, delay=None) Delay I/O by value given or the value given in --iodelay option. exit(self) Terminate script with an exit value of 0 when all tests passed and a value of 1 when there is at least one test failure. get_dirname(self, dir=None) Return a unique directory name under the given directory. get_filename(self, dir=None) Return a unique file name under the given directory. get_logname(self, remote=False) Get next log file name. get_marker_index(self, marker_id=None) Find packet index of the trace marker given by the marker id
marker_id:
ID of trace marker to find in the packet trace, if this is not given the current marker id is used [default: None]
get_name(self) Get unique name for this instance. insert_trace_marker(self, name=None) Send a LOOKUP for an unknown file to have a marker in the packet trace and return the trace marker id
name:
Use this name as the trace marker but the caller must make sure this is a unique name in order to find the correct index for this marker. This could also be used to add any arbitrary information to the packet trace [default: None]
lock_files(self, lock_type=None, offset=0, length=0) Lock all files opened by open_files(). need_run_test(self, testname) Return True only if user explicitly requested to run this test open_files(self, mode, create=True) Open files according to given mode, the file descriptors are saved internally to be used with write_files(), read_files() and close_files(). The number of files to open is controlled by the command line option '--nfiles'. The mode could be either 'r' or 'w' for opening files for reading or writing respectively. The open flags for mode 'r' is O_RDONLY while for mode 'w' is O_WRONLY|O_CREAT|O_SYNC. The O_SYNC is used to avoid the client buffering the written data. process_client_option(self, option='client', remote=True, count=1) Process the client option Clients are separated by a "," and each client definition can have the following options separated by ":": client:server:export:nfsversion:port:proto:sec:mtpoint
option:
Option name [default: "client"]
remote:
Expect a client hostname or IP address in the definition. If this is set to None do not verify client name or IP. [default: True]
count:
Number of client definitions to expect. If remote is True, return the number of definitions listed in the given option up to this number. If remote is False, return exactly this number of definitions [default: 1]
Examples: # Using positional arguments with nfsversion=4.1 for client1 client=client1:::4.1,client2 # Using named arguments instead client=client1:nfsversion=4.1,client2
process_option(self, value, arglist=[], typemap={}) Process option with a list of items separated by "," and each item in the list could have different arguments separated by ":".
value:
String of comma separated elements
arglist:
Positional order of arguments, if this list is empty, then use named arguments only [default: []]
typemap:
Dictionary to convert arguments to their given types, where the key is the argument name and its value is the type function to use to convert the argument [default: {}]
read_files(self) Read a block of data (size given by --rsize) from all files opened by open_files() for reading. remove_test(self, testname) Remove all instances of test from the list of tests to run run_func(self, func, *args, **kwargs) Run function with the given arguments and return the results. All positional arguments are passed to the function while the named arguments change the behavior of the method. Object attribute "oserror" is set to the OSError object if the function fails.
msg:
Test assertion message [default: None]
err:
Expected error number [default: 0]
run_tests(self, **kwargs) Run all test specified by the --runtest option.
testnames:
List of testnames to run [default: all tests given by --testnames]
All other arguments given are passed to the test methods.
scan_options(self) Process command line options. Process all the options in the file given by '--file', then the ones in the command line. This allows for command line options to over write options given in the file. Format of options file: # For options expecting a value <option_name> = <value> # For boolean (flag) options <option_name> Process options files and make sure not to process the same file twice, this is used for the case where HOMECFG and CWDCFG are the same, more specifically when environment variable HOME is not defined. Also, the precedence order is defined as follows: 1. options given in command line 2. options given in file specified by the -f|--file option 3. options given in file specified by ./.nfstest 4. options given in file specified by $HOME/.nfstest 5. options given in file specified by /etc/nfstest NOTE: Must use the long name of the option (--<option_name>) in the file. set_nfserr_list(self, nfs3list=[], nfs4list=[], nlm4list=[], mnt3list=[]) Temporaly set the NFS list of expected NFS errors in the next call to trace_open setup(self, nfiles=None) Set up test environment. Create nfiles number of files [default: --nfiles option] str_args(self, args) Return the formal string representation of the given list where string objects are truncated. test(self, expr, msg, subtest=None, failmsg=None, terminate=False) Test expr and display message as PASS/FAIL, terminate execution if terminate option is True.
expr:
If expr is true, display as a PASS message, otherwise as a FAIL message
msg:
Message to display
subtest:
If given, append this string to the displayed message and mark this test as a member of the sub-group given by msg
failmsg:
If given, append this string to the displayed message when expr is false [default: None]
terminate:
Terminate execution if true and expr is false [default: False]
If tverbose=normal or level 1: Sub-group message is displayed as a PASS/FAIL message including the number of tests that passed and failed within the sub-group If tverbose=verbose or level 2: All tests messages are displayed
test_description(self, tname=None) Return the test description for the current test test_group(self, msg) Display heading message and start a test group. If tverbose=group or level 0: Group message is displayed as a PASS/FAIL message including the number of tests that passed and failed within this test group. If tverbose=normal|verbose or level 1|2: Group message is displayed as a heading messages for the tests belonging to this test group. test_info(self, msg) Display info message. test_options(self, name=None) Get options for the given test name. If the test name is not given it is determined by inspecting the stack to find which method is calling this method. testid_count(self, tid) Return the number of instances the testid has occurred. trace_open(self, *kwts, **kwds) This is a wrapper to the original trace_open method where the packet trace is scanned for NFS errors and a failure is logged for each error found not given on the list of expected errors set with method set_nfserr_list. Scanning for NFS error is done only if --nfserrors option has been specified. trace_start(self, *kwts, **kwds) This is a wrapper to the original trace_start method to reset the trace marker state verify_client_option(self, tclient_dict, option='client') Verify the client option is required from the list of tests to run. Also, check if enough clients were specified to run the tests.
tclient_dict:
Dictionary having the number of clients required by each test
option:
Option name [default: "client"]
verify_file_data(self, msg=None, pattern=None, path=None, filesize=None, nlen=None, cmsg='') Verify file by comparing the data to the given pattern. It returns the results from the compare_data method.
msg:
Test assertion message. If set to None, no assertion is done it just returns the results [default: None]
pattern:
Data pattern function or string. If this is a function, it must take offset and size as positional arguments. If given as a string, the pattern repeats over and over starting at offset = 0 [default: self.data_pattern]
path:
Absolute path of file to verify [default: self.absfile]
filesize:
Expected size of file to be verified [default: self.filesize]
nlen:
Size of sample data to return if a difference is found [default: compare_data default]
cmsg:
Message to append to debug message if a difference is found. If set to None, debug messages are not displayed [default: '']
warning(self, msg) Display warning message. write_data(self, fd, offset=0, size=None, pattern=None, verbose=0, dlevel='DBG5') Write data to the file given by the file descriptor
fd:
File descriptor
offset:
File offset where data will be written to [default: 0]
size:
Total number of bytes to write [default: --filesize option]
pattern:
Data pattern to write to the file [default: data_pattern default]
verbose:
Verbosity level [default: 0]
write_files(self) Write a block of data (size given by --wsize) to all files opened by open_files() for writing. Static methods defined here: ---------------------------- get_list(value, nmap, sep=',') Given the value as a string of 'comma' separated elements, return a list where each element is mapped using the dictionary 'nmap'. nmap = {"one":1, "two":2} out = x.get_list("one", nmap) # out = [1] out = x.get_list("one,two", nmap) # out = [1,2] out = x.get_list("two,one", nmap) # out = [2,1] out = x.get_list("one,three", nmap) # out = None str_list(value, vtype=<class 'str'>, sep=',') Return a list of <vtype> elements from the comma separated string.
 

SEE ALSO

baseobj(3), formatstr(3), nfstest.host(3), nfstest.nfs_util(3), nfstest.rexec(3), nfstest.utils(3), packet.nfs.nfs3_const(3), packet.nfs.nfs4_const(3)

 

BUGS

No known bugs.  

AUTHOR

Jorge Mora (mora@netapp.com)


 

Index

NAME
DESCRIPTION
CLASSES
class TestUtil(nfstest.nfs_util.NFSUtil)
SEE ALSO
BUGS
AUTHOR

This document was created by man2html, using the manual pages.
Time: 16:08:34 GMT, July 19, 2021