[Openmp-dev] testsuite script error

Carlo Bertolli cbertol at us.ibm.com
Tue May 19 19:51:14 PDT 2015


Hi Sunita

Thanks for explaining. I may have missed some previous explanation e-mails
but here is my question (and apologies if you already explained elsewhere):
does the "make test" command run the testsuite or is this only running some
sort of regression test?

Thanks!

-- Carlo



From:	Sunita Chandrasekaran <sunita at cs.uh.edu>
To:	Carlo Bertolli/Watson/IBM at IBMUS
Cc:	Millad Ghane <millad.mg at gmail.com>, "Peyton, Jonathan L"
            <jonathan.l.peyton at intel.com>,
            "openmp-dev at dcs-maillist2.engr.illinois.edu"
            <openmp-dev at dcs-maillist2.engr.illinois.edu>, Sunita
            Chandrasekaran <sunita at cs.uh.edu>
Date:	05/19/2015 04:52 PM
Subject:	Re: [Openmp-dev] testsuite script error
Sent by:	sunisg123 at gmail.com



Hi Carlo

Millad and I were discussing....

Very sorry about the $(CLASH) Typo!!
Yes, It should have been $(SLASH).

Jonathan: Sorry, attaching an updated Makefile with the typo corrected and
C_INCLUDE_PATH...

I think this typo was not picked up at our end, since our machine
recognized omp.h correctly. But thanks Carlo, for identifying this.

Regarding 'permission denied', it is perfectly fine, we get it too.
Please continue with the run and it should work OK, please let us know what
you find.

Most likely you will see something like this:

.......
PASS: OpenMPValidationSuite :: lin_32e/test_omp_test_lock.ll (120 of 122)
PASS: OpenMPValidationSuite :: lin_32e/test_omp_test_nest_lock.ll (121 of
122)
PASS: OpenMPValidationSuite :: lin_32e/test_omp_threadprivate.ll (122 of
122)
Testing Time: 132.75s
********************
Failing Tests (4):
    OpenMPValidationSuite :: lin_32e/orph_test_omp_for_schedule_guided.ll
    OpenMPValidationSuite :: lin_32e/orph_test_omp_task_untied.ll
    OpenMPValidationSuite :: lin_32e/orph_test_omp_taskyield.ll
    OpenMPValidationSuite :: lin_32e/test_omp_for_schedule_guided.ll

  Expected Passes    : 116
  Expected Failures  : 2
  Unexpected Failures: 4
make: *** [test] Error 1


Thanks and Apologies once again (Jonathan! :-))
Sunita



On Tue, May 19, 2015 at 2:15 PM, Carlo Bertolli <cbertol at us.ibm.com> wrote:
  Hi Millad, Sunita

  Thanks for your efforts and no worries for answering late.

  I am afraid that this thing does not work yet, and I am surprised that it
  works at all on your system. Looking here:

  http://llvm.org/svn/llvm-project/openmp/trunk/runtime/Makefile

  you'll read:

  export INCLUDE_PATH=$(libiomp5_path)$(SLASH)..$(SLASH)..$(SLASH)common$
  (CLASH)include:$(INCLUDE_PATH) ; \

  Can you see the CLASH use at the end of the string? That makes the
  include path wrong and CLASH is not defined anywhere.
  Also, I am using clang as compiler for building libiomp and the tests and
  INCLUDE_PATH is not an input environment variable for it. This may also
  be true for gcc, I have not tried it yet.
  I found out that C_INCLUDE_PATH is instead working for clang (found it
  here: https://gcc.gnu.org/onlinedocs/gcc/Environment-Variables.html).

  Once I fix that line to the following:

  export C_INCLUDE_PATH=$(libiomp5_path)$(SLASH)..$(SLASH)..$(SLASH)common$
  (SLASH)include:$(INCLUDE_PATH) ; \

  I still get an error, which (beware!) may be system or environment
  specific:

  Testing for "has_openmp":
  Generating sources .............. success
  Compiling soures ................ success
  Running test with 8 threads .sh: ./bin/c/test_has_openmp: Permission
  denied
  .... failed 100% of the tests

  Any clues?


  Thanks!!

  -- Carlo


  Inactive hide details for Millad Ghane ---05/18/2015 06:51:01 PM---Hi
  all, *Jonathan:* Thanks for the commit.Millad Ghane ---05/18/2015
  06:51:01 PM---Hi all, *Jonathan:* Thanks for the commit.

  From: Millad Ghane <millad.mg at gmail.com>
  To: "Peyton, Jonathan L" <jonathan.l.peyton at intel.com>, Carlo
  Bertolli/Watson/IBM at IBMUS
  Cc: Sunita Chandrasekaran <sunita at cs.uh.edu>, "
  openmp-dev at dcs-maillist2.engr.illinois.edu" <
  openmp-dev at dcs-maillist2.engr.illinois.edu>
  Date: 05/18/2015 06:51 PM



  Subject: Re: [Openmp-dev] testsuite script error



  Hi all,

  Jonathan: Thanks for the commit.

  Carlo: Sorry for late response. Sunita and I were looking to find a time
  slot to meet and discuss the problem. That's why I didn't respond to your
  email. Last email from Sunita was the solution to your problem. We are
  waiting for your feedback.


  Regards,
  Millad


  On Mon, May 18, 2015 at 4:44 PM, Peyton, Jonathan L <
  jonathan.l.peyton at intel.com> wrote:
        I have just committed this:





        Index: runtime/Makefile


        ===================================================================


        --- runtime/Makefile    (revision 237615)


        +++ runtime/Makefile    (working copy)


        @@ -61,6 +61,7 @@


                 if [ -d "$(omp_root)$(SLASH)..$(SLASH)testsuite$
        (SLASH)LLVM-IR" ] ; then \


                                export TESTSUITE_TEMP=$(realpath $
        (omp_root))$(SLASH)tmp ; \


                                export LIBRARY_PATH=$(libiomp5_path):$
        (LIBRARY_PATH) ; \


        +                       export INCLUDE_PATH=$(libiomp5_path)$
        (SLASH)..$(SLASH)..$(SLASH)common$(CLASH)include:$(INCLUDE_PATH) ;
        \


                                export LD_LIBRARY_PATH=$(libiomp5_path):$
        (LD_LIBRARY_PATH) ; \


                                export DYLD_LIBRARY_PATH=$(libiomp5_path):$
        (DYLD_LIBRARY_PATH) ; \


                                cd $(omp_root)$(SLASH)..$(SLASH)testsuite ;
        \


        Index: testsuite/README_LLVM_OPENMP


        ===================================================================


        --- testsuite/README_LLVM_OPENMP        (revision 237615)


        +++ testsuite/README_LLVM_OPENMP        (working copy)


        @@ -8,7 +8,7 @@





        Two new files have been added to openmp/runtime: check-openmp.pl
        and check-openmp-test.pl


        Go to /openmp/runtime, run:


        -make test


        +make test compiler=clang


        make test-clean





        ------------------------------------------------------------------------------






        -- Johnny





        From: sunisg123 at gmail.com [mailto:sunisg123 at gmail.com] On Behalf Of
        Sunita Chandrasekaran
        Sent: Monday, May 18, 2015 4:42 PM
        To: Carlo Bertolli
        Cc: Peyton, Jonathan L; Millad Ghane;
        openmp-dev at dcs-maillist2.engr.illinois.edu; Sunita Chandrasekaran



        Subject: Re: [Openmp-dev] testsuite script error





        Sounds good, Carlo!! Thanks much Jonathan!


        -Sunita





        On Mon, May 18, 2015 at 4:38 PM, Carlo Bertolli <cbertol at us.ibm.com
        > wrote:



              Great! Let me wait for Jonathan to update the trunk and I
              will get it from there.

              Thanks

              -- Carlo


              Inactive hide details for "Peyton, Jonathan L" ---05/18/2015
              05:35:24 PM---I’m on it! -- Johnny"Peyton, Jonathan L"
              ---05/18/2015 05:35:24 PM---I’m on it! -- Johnny

              From: "Peyton, Jonathan L" <jonathan.l.peyton at intel.com>
              To: Sunita Chandrasekaran <sunita at cs.uh.edu>, Carlo
              Bertolli/Watson/IBM at IBMUS
              Cc: Millad Ghane <millad.mg at gmail.com>, "
              openmp-dev at dcs-maillist2.engr.illinois.edu" <
              openmp-dev at dcs-maillist2.engr.illinois.edu>
              Date: 05/18/2015 05:35 PM
              Subject: RE: [Openmp-dev] testsuite script error











              I’m on it!

              -- Johnny

              From: sunisg123 at gmail.com [mailto:sunisg123 at gmail.com] On
              Behalf Of Sunita Chandrasekaran
              Sent: Monday, May 18, 2015 3:52 PM
              To: Carlo Bertolli; Peyton, Jonathan L
              Cc: Millad Ghane; openmp-dev at dcs-maillist2.engr.illinois.edu;
              Sunita Chandrasekaran
              Subject: Re: [Openmp-dev] testsuite script error

              Hi Carlo

              Sorry for the delay. We were able to fix the problem by
              adding a line to the Makefile that will fetch omp.h for you,
              in case your system doesn't find it by default. Not finding
              omp.h gave you those errors, it should go away now.

              Jonathan: Could you please help us update the Makefile in
              openmp/runtime/ with the one attached?
              If for some reason, you cannot access this Makefile, please
              pick it up from
              https://www.dropbox.com/s/5qirpnb6rcupgwp/Makefile?dl=0

              Once this Makefile is used, the tests will run for completion
              and the log files will automatically be deleted.

              Also in /openmp/testsuite/README_LLVM_OPENMP, if you could
              please mention
              make test compiler=clang
              instead of
              make test
              in line 11.
              This is more clear.

              Thanks for pointing this out and hope this works.
              Please let us know.

              Sunita


              On Fri, May 15, 2015 at 7:32 PM, Sunita Chandrasekaran <
              sunisg123 at gmail.com> wrote:



                    Hi Carlo
                    Thanks for bringing this to our notice. We are checking
                    things at our end, will write back to you shortly with
                    a solution.
                    Cheers
                    Sunita


                    On Thu, May 14, 2015 at 10:19 PM, Carlo Bertolli <
                    cbertol at us.ibm.com> wrote:


                          Hi Millad

                          Thanks for your answer, now I see what is
                          happening.

                          However, please correct me if I am saying
                          something wrong, I see that these .ll files are
                          generated by the Makefile in the testsuite/bin/
                          directory.
                          When I run "make test" in runtime, I get the
                          following errors at the end, after all tests have
                          been compiled and run:

                          Makefile:19: recipe for target
                          'c/orph_ctest_omp_parallel_default' failed
                          make[2]: *** [c/orph_ctest_omp_parallel_default]
                          Error 1
                          In file included from c/test_omp_get_wtick.c:4:
                          c/omp_testsuite.h:11:10: fatal error: 'omp.h'
                          file not found
                          #include <omp.h>
                                  ^
                          1 error generated.

                          and similar..

                          I guess this is because the setting of the
                          include path is not working (at least on my
                          machine). What is the right place to fix it?
                          testsuite/bin/Makefile? Should I fix it by hand
                          before running make test (in the sense that right
                          now "make test" seems to do all the work for me)?

                          Also, running "make test" in runtime/ fills up my
                          testsuite/ directory with .log files. Is this
                          expected? Incidentally, the .log files for
                          orphaned tests seem to be failing a lot (if not
                          them all).


                          Thanks and apologies if I am missing some of the
                          point

                          -- Carlo


                          Inactive hide details for Millad Ghane
                          ---05/14/2015 08:46:51 PM---Hi Carlo, I am
                          responding on behalf of Sunita.Millad Ghane
                          ---05/14/2015 08:46:51 PM---Hi Carlo, I am
                          responding on behalf of Sunita.

                          From: Millad Ghane <millad.mg at gmail.com>
                          To: Carlo Bertolli/Watson/IBM at IBMUS
                          Cc: Sunita Chandrasekaran <sunita at cs.uh.edu>, "
                          openmp-dev at dcs-maillist2.engr.illinois.edu" <
                          openmp-dev at dcs-maillist2.engr.illinois.edu>,
                          sunita chandrasekaran <sunisg123 at gmail.com>
                          Date: 05/14/2015 08:46 PM
                          Subject: Re: [Openmp-dev] testsuite script error









                          Hi Carlo,

                          I am responding on behalf of Sunita.

                          The "make test" command in the runtime folder
                          does not only do the "make ctest". The "make
                          ctest" here actually tries to generate the LL
                          files. And, these LL files are consumed
                          afterwards by llvm-lit command to see whether the
                          test is passed or not. So, "make test" command is
                          not solely "make ctest" and the test part happens
                          with another command. We did provide this rule,
                          "make test", to make your life easier.
                          The peace of code that you mentioned is actually
                          generating the LL files.

                          At first, we proposed to put the testing rule
                          (make test) in the testsuite. However, it was
                          rejected. So, we tried to include it in the
                          runtime folder for sake of OpenMP testers.

                          And make -j: Simply, it tries to build a package
                          with multiple jobs in parallel in order to
                          speedup building. For example, with (make -j 8),
                          we are trying to speedup the build process with 8
                          jobs (threads) in parallel. If the number is not
                          provided, like "make -j", then there is no limit
                          to number jobs and it tries to run it with as
                          many as possible.


                          Bests Regards,
                          Millad Ghane


                          On Thu, May 14, 2015 at 10:19 AM, Carlo Bertolli
                          <cbertol at us.ibm.com> wrote:



                                Hi

                                After recent commits, I am now able to
                                compile libiomp5.so and use it in the
                                tests.
                                I noticed that the makefile in the runtime
                                directory ultimately calls "make ctest" in
                                the testsuite directory.

                                If I do this manually "make ctest" inside
                                testsuite after having fixed the Makefile
                                (again, in testuite), all selected tests
                                are run and verified, but at the end I see
                                this:

                                cd bin/; make -j
                                make[1]: Entering directory
                                '/gsa/yktgsa-p6/05/llvm-coral-build/repos/ppc64le/libiomp/testsuite/bin'

                                clang -fopenmp -S -emit-llvm
                                c/test_omp_sections_reduction.c -o
                                c/test_omp_sections_reduction.ll
                                clang -fopenmp -S -emit-llvm
                                c/orph_ctest_omp_lock.c -o
                                c/orph_ctest_omp_lock.ll
                                clang -fopenmp -S -emit-llvm
                                c/orph_ctest_omp_parallel_if.c -o
                                c/orph_ctest_omp_parallel_if.ll

                                ....more similar commands leading to
                                errors..

                                Maybe I should not use the makefile in the
                                testsuite directory, but apparently that is
                                what the "make test" command does when run
                                from the runtime directory.

                                Do you have any clues about the meaning of
                                that "make -j" command? Why is it there and
                                what is the intended for?
                                Maybe I am using a wrong repo for updating
                                my local copy..


                                Thanks

                                -- Carlo



                                Inactive hide details for Sunita
                                Chandrasekaran ---05/08/2015 03:58:04
                                PM---Hi Carlo If you could simply use 'make
                                test' from oSunita Chandrasekaran
                                ---05/08/2015 03:58:04 PM---Hi Carlo If you
                                could simply use 'make test' from
                                openmp/runtime folder, that is all

                                From: Sunita Chandrasekaran <
                                sunita at cs.uh.edu>
                                To: Carlo Bertolli/Watson/IBM at IBMUS
                                Cc: "
                                openmp-dev at dcs-maillist2.engr.illinois.edu"
                                <openmp-dev at dcs-maillist2.engr.illinois.edu
                                >, Millad Ghane <millad.mg at gmail.com>
                                Date: 05/08/2015 03:58 PM
                                Subject: Re: [Openmp-dev] testsuite script
                                error
                                Sent by: sunisg123 at gmail.com









                                Hi Carlo

                                If you could simply use 'make test' from
                                openmp/runtime folder, that is all that is
                                needed.

                                Sorry if the 2 READMEs are creating a
                                confusion.

                                Please drop us a note, if you have further
                                issues.

                                Thanks
                                Sunita
                                P.S: Copied is our Ph.D. student here at
                                UH.

                                On Fri, May 8, 2015 at 2:27 PM, Carlo
                                Bertolli <cbertol at us.ibm.com> wrote:



                                      Hi all

                                      After fetching the latest version of
                                      the library from here:

                                      origin http://llvm.org/git/openmp.git
                                      (fetch)


                                      I started seeing the following error
                                      when I run "make ctest" in the
                                      testsuite directory:

                                      Testing for "has_openmp":
                                      Generating sources ..........Could
                                      not open the sourcefile for the main
                                      program ompts_standaloneProc.c at ./
                                      template_parser_c.pl line 51.
                                      Could not open the sourcefile for the
                                      main program ompts_standaloneProc.c
                                      at ./template_parser_c.pl line 51.
                                      ERROR: Generation of sourcecode for
                                      the test failed.
                                      ERROR: Generation of sourcecode for
                                      the crosstest failed.
                                      .... failed

                                      for all tests. This happens equally
                                      on an Intel machine and a PCC64LE
                                      one.

                                      What am I doing wrong?


                                      Thanks

                                      -- Carlo

                                      _______________________________________________

                                      Openmp-dev mailing list
                                      Openmp-dev at dcs-maillist2.engr.illinois.edu

                                      http://lists.cs.uiuc.edu/mailman/listinfo/openmp-dev





















[attachment "Makefile" deleted by Carlo Bertolli/Watson/IBM]




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/openmp-dev/attachments/20150519/f0365b6b/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/openmp-dev/attachments/20150519/f0365b6b/attachment.gif>


More information about the Openmp-dev mailing list