Re: PROC MEANS utility file open failed (once in 2005 was: proc

u should use BY instead of CLASS. That requires a PROC SORT before, but the
memory requirements should decrease significant.
Regards,
Gerhard



On Thu, 30 Nov 2006 15:46:55 -0500, Martin Mathis
<martin.u.mathis@BANKOFAMERICA.COM> wrote:

>Thanks for the suggestion, Adam.
>
>I'm already using NWAY:
>
>proc means data=outlib.test_tpr noprint missing nway nothreads sumsize=max;
>
> class me_dt m3_level3 m2_level2 m1_level mkt_pgm_nm2 fin_sect_tx2
> mkt_sctr_nm prod_brnd_nm prod_tp_nm vinqtr vinyr client_gen3
> client_gen2 client_gen1;
>
>------------------------
>ERROR: Utility file open failed.
>NOTE: The SAS System stopped processing this step because of errors.
>NOTE: SAS set option OBS=0 and will continue to check statements. This may
>cause NOTE: No observations in data set.
>NOTE: There were 123316786 observations read from the data set
>OUTLIB.TEST_TPR.
>WARNING: The data set WSPACE.NEW_TPR_200610 may be incomplete. When this
>step was stopped there were 0 observations and 253 variables.
>
>NOTE: PROCEDURE MEANS used (Total process time):
> real time 1:19:42.43
> user cpu time 58:31.51
> system cpu time 2:26.08
> Memory 360984k
> Page Faults 23440
> Page Reclaims 220653
> Page Swaps 0
> Voluntary Context Switches 95063
> Involuntary Context Switches 295366
> Block Input Operations 0
> Block Output Operations 0
>------------------------------
>
>It may still barf on the combination of all of these vars from 123 million
>observations?
>
>MM
>
>On Thu, 30 Nov 2006 12:12:16 -0800, Adam Smith <dobie_dad@HOTMAIL.COM>
>wrote:
>
>>Does this help?
>>
>>SN-V9-017594
>>ERROR: Utility file open failed in PROC MEANS/SUMMARY
>>
>> PROC MEANS/SUMMARY may issue the following error message when a CLASS
>> statement includes many variables:
>>
>> ERROR: Utility file open failed.
>>
>> Adding the NWAY option to the PROC statement will correct the problem.
>>
>> The reason this fails is because, without NWAY, the procedure will try
>> to create all possible _TYPE_ combinations which is 2^n. In the process,
>> it runs out of memory and the current summary object tries to open one
>> file for each _TYPE_ being created, which results in the above error
>> message.
>>
>>
>>
>>>From: Martin Mathis <martin.u.mathis@BANKOFAMERICA.COM>
>>>Reply-To: Martin Mathis <martin.u.mathis@BANKOFAMERICA.COM>
>>>To: SAS-L@LISTSERV.UGA.EDU
>>>Subject: PROC MEANS utility file open failed (once in 2005 was: proc
>>> surveyfreq)
>>>Date: Thu, 30 Nov 2006 14:55:26 -0500
>>>
>>>I dug this up via Google search on "Utility file open failed".
>>>
>>>Julia, if you are still on this list, did SAS tech support give you an
>>>answer or solution? Did you ever get past the error?
>>>
>>>I'm running into the same problem with a PROC MEANS.
>>>
>>>Using SAS 9.1.3 on AIX so the issue should be fixed.
>>>System and means option nothreads with which the issue shouldn't occur in
>>>the first place.
>>>Dataset with about 123 million obs.
>>>Trying to get sum of about 200 vars by 14 nway class variables.
>>>Job runs for over an hour then abends with ERROR: Utility file open
>failed.
>>>I monitored available space in saswork and the filesystem did not fill up
>>>while the job was running.
>>>It also didn't really build up any temp files, a brief allocation of a
>>>utility dir/file that would again disappear aside. Is that the utility
>file
>>>it subsequently can't find?
>>>
>>>I'm stumped. Is the error misleading? Am I running out of memory? Am I out
>>>of space in a filesystem I'm not aware of SAS using it? Is the task simply
>>>too complex?
>>>
>>>I might just have to run this past SAS tech support, too, but any ideas or
>>>a known existing reply from SI are appreciated!
>>>
>>>MM
>>>
>>>On Thu, 27 Jan 2005 06:25:56 -0800, julia_drew@brown.edu
>>><julia_drew@BROWN.EDU> wrote:
>>>
>>> >Hello;
>>> >
>>> >Thank you for your reply. I am running version 9.1 (TS1M3) on a Unix
>>> >server, but this should be the version for which this error is already
>>> >fixed. I am not sure that the hot fix provided by SAS technical support
>>> >will affect version 9.1 (TS1M3).
>>> >
>>> >Regards;
>>> >
>>> >Julia
>>> >
>>> >Julia Ana Drew
>>> >Graduate Student
>>> >Department of Sociology/Population Studies and Training Center
>>> >Brown University
>>> >P.O. Box 1916
>>> >Providence, RI 02912
>>> >
>>> >David L. Cassell wrote:
>>> >> "julia_drew@brown.edu" <julia_drew@BROWN.EDU> wrote:
>>> >> > I am trying to use PROC SURVEYFREQ for the first time and am
>>> >getting
>>> >> an
>>> >> > error I've never seen before. When I try to use it, the error
>>> >message
>>> >> > "utility file open failed." appears. Is this something that anyone
>>> >has
>>> >> > experience with?
>>> >>
>>> >> I haven't seen it before. But a search of the SAS Tech Support area
>>> >> turned up the note below. Are you running this on a MVS mainframe
>>> >using
>>> >> TK utility files?
>>> >>
>>> >>
>>> >>
>>> >
>>>=============================================== ===========================
>>> >>
>>> >> You may receive the following error message when attempting to
>>> >execute a
>>> >> SAS procedure which uses Threaded Kernel (TK) utility files.
>>> >>
>>> >> Utility file open failed.
>>> >>
>>> >> Some of the procedures which may be affected are: SORT, SUMMARY,
>>> >> SQL,
>>> >> FREQ, MEANS, REPORT and DMREG
>>> >>
>>> >> This is corrected in SAS 9.1 (TS1M3).
>>> >>
>>> >>
>>> >> A Technical Support hot fix for SAS 9.1 (TS1M0) for this
>>> >> issue is available at:
>>> >>
>>> >>
>>> >>
>>> >http://www.sas.com/techsup/download/...st.html#012666
>>> >>
>>> >> For customers running SAS with Asian Language Support (DBCS), this
>>> >> hot fix should be downloaded from:
>>> >>
>>> >>
>>> >>
>>> >http://www.sas.com/techsup/download/...st.html#012666
>>> >>
>>> >>
>>> >> A Technical Support hot fix for SAS 9.1.2 (9.1 TS1M2) for this
>>> >> issue is available at:
>>> >>
>>> >>
>>> >>
>>> >http://www.sas.com/techsup/download/...st.html#012666
>>> >>
>>> >> For customers running SAS with Asian Language Support (DBCS), this
>>> >> hot fix should be downloaded from:
>>> >>
>>> >>
>>> >>
>>> >http://www.sas.com/techsup/download/...st.html#012666
>>> >>
>>> >>
>>> >> Product: Base SAS
>>> >>
>>> >> Component: SAS data library I/O
>>> >>
>>> >> Priority: HIGH
>>> >>
>>> >> Note Type: Documented Problem
>>> >>
>>> >> Date: Tue, 14 Dec 2004
>>> >>
>>> >>
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> Operating System and Source Fix Information
>>> >>
>>> >>
>>> >>
>>> >|---------------------+--------------------------+---------------------|
>>> >> | System | Release Reported | Release Fixed
>>> >|
>>> >>
>>> >|---------------------+--------------------------+---------------------|
>>> >> | OS/390 (MVS) | 9 TSM0 | 9.1 TS1M3
>>> >|
>>> >>
>>> >|---------------------+--------------------------+---------------------|
>>> >> | OS/390 (MVS) | 9.1 TS1M0 | 9.1 TS1M3
>>> >|
>>> >>
>>> >|---------------------+--------------------------+---------------------|
>>> >> | OS/390 (MVS) | 9.1 TS1M2 | 9.1 TS1M3
>>> >|
>>> >>
>>> >|---------------------+--------------------------+---------------------|
>>> >>
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> Unless otherwise stated above, no fixes are available for this
>>> >issue.
>>> >> ================================================== ===================
>>> >>
>>> >> HTH,
>>> >> David
>>> >> --
>>> >> David Cassell, CSC
>>> >> Cassell.David@epa.gov
>>> >> Senior computing specialist
>>> >> mathematical statistician
>>
>>________________________________________________ _________________
>>MSN Shopping has everything on your holiday list. Get expert picks by
>style,
>>age, and price. Try it!
>>http://shopping.msn.com/content/shp/?
>ctId=8000,ptnrid=176,ptnrdata=200601&tcode=wlmtag line