o ^i*#@sddlZddlZddlZddlZddlmZddlmZddlm Z m Z m Z ddl m Z mZmZddlmZddlmZmZd Zd efd d Zd ed efddZd edeeeefd efddZd ed dfddZ d,dddddddeedeedeed eedeeeefdeef ddZd,deed dfdd Zd,deed dfd!d"Zd-deed$eed dfd%d&Z      d.deedeedeed eedeedeef d'd(Z d,ddddddd)deedeedeed eedeedeef d*d+Z!dS)/N)knobs)proton)set_profiling_offset_profiling_onis_command_line) HookManager LaunchHookInstrumentationHook)BaseMode)OptionalUnionrreturncCs0tjjjj}|dkrdS|dkrdStd)Ncudacuptihip roctracerz/No backend is available for the current target.)tritonruntimedriveractiveget_current_targetbackend ValueError)rrR/var/www/html/RAG/RAG_venv/lib/python3.10/site-packages/triton/profiler/profile.py_select_backends rrcCsFd}|dkr!tjj}|dur!tttjjdddd}|S)Nrbackendsnvidialib) rr cupti_dirstrpathlibPath__file__parentabsolute)rlib_pathrrr_get_backend_default_paths &r)modecCs>|dkrtjjjj}|r|d|S|S|rt|SdS)Ninstrumentation:r)rrrrrrr")rr*prefixrrr _get_mode_str&sr.cCsB|dkrddg}|D]}t|ddurtd|dq dSdS)NrHIP_VISIBLE_DEVICESCUDA_VISIBLE_DEVICESz3Proton does not work when the environment variable zK is set on AMD GPUs. Please unset it and use `ROCR_VISIBLE_DEVICES` instead)osgetenvr)rhip_device_envsenvrrr _check_env-s r5shadowtreecontextdatarr*hooknamer9r:r;c CstrdSt|durtn|}|durtn|}t|}t||}t|t||||||}|dkr;t t ||dkrGt t |||S)a Start profiling with the given name and backend. Usage: ```python proton.start("my_profile") # do something proton.finalize() ``` Args: name (str, optional): The name (with path) of the profiling session. If not provided, the default name is "~/proton.", where suffix is the default format according to the data type. For example, if data is "tree", the default name is "~/proton.hatchet". context (str, optional): The context to use for profiling. Available options are ["shadow", "python"]. Defaults to "shadow". data (str, optional): The data structure to use for profiling. Available options are ["tree", "trace"]. Defaults to "tree". backend (str, optional): The backend to use for profiling. Available options are [None, "cupti", "roctracer", "instrumentation"]. Defaults to None, which automatically selects the backend matching the current active runtime. mode (Union[str, BaseMode], optional): The "mode" to use for profiling, which is specific to the backend. Can be a string or an instance of BaseMode (or any subclass thereof). Defaults to None. For "cupti", available options are [None, "pcsampling"]. For "roctracer", available options are [None]. For "instrumentation", available options are [None]. Each mode has a set of control knobs following with the mode name. For example, "pcsampling" has an "interval" control knob, expressed as "pcsampling:interval=1000". hook (str, optional): The hook to use for profiling. Available options are [None, "launch"]. Defaults to None. Returns: session (int): The session ID of the profiling session. Nrr+) rrDEFAULT_PROFILE_NAMErr)r.r5 libprotonstartrregisterr r ) r<r9r:rr*r; backend_pathmode_strsessionrrrr?7s/ r?rCcCBtr |dkr tdt||durtdSt|dS)z Activate the specified session. The profiling session will be active and data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) Returns: None rzEOnly one session can be activated when running from the command line.N)rrractivater> activate_allrCrrrrE~    rEcCrD)a  Stop the specified session. The profiling session's data will still be in the memory, but no more data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) Returns: None rzGOnly one session can be deactivated when running from the command line.N)rrr deactivater>deactivate_allrGrrrrIrHrIr output_formatcCsLt||durtt|dStr|dkrtdt||dS)a Finalizes a profiling session. Flush and write the profiling data to the file specified by the session name. Args: session (int, optional): The session ID to finalize. If None, all sessions are finalized. Defaults to None. output_format (str, optional): The output format for the profiling results. Available options are ["hatchet", "chrome_trace"]. Returns: None NrzEOnly one session can be finalized when running from the command line.)r unregisterrr> finalize_allrrfinalize)rCrKrrrrNs rNcs&tfdd}|S)z Context manager for profiling. Internally use only. Args: See start() for the arguments. Returns: wrapper (function): The wrapped function. cs.td}|i|}t||S)Nr8)r?rI)argskwargsrCretrr9r:funcr;r*r<rrwrappersz_profiling..wrapper) functoolswraps)rSr<r9r:rr*r;rTrrRr _profilingsrWr<r9r:rr*r;c s8|durfdd}|St|dS)z Decorator for profiling. Usage: ```python @proton.profile def foo(): pass ``` Args: See start() for the arguments. Returns: decorator (function): The decorator function. Nc st|dS)NrXrW)frr9r:r;r*r<rr decoratorszprofile..decoratorrXrY)rSr<r9r:rr*r;r\rr[rprofilesr])N)Nr)Nr6r7NNN)"rUrr1r#rtriton._C.libprotonrr>flagsrrrhooksrr r r*r typingr r r=r"rr)r.r5r?intrErIrNrWr]rrrrs    "   G