CoolFace
Modelpublic

buelfhood/SOCO-Java-CodeBERTa-Softmax-PairClass-VAST

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes19downloads
Model Card

SentenceTransformer based on huggingface/CodeBERTa-small-v1

This is a sentence-transformers model finetuned from huggingface/CodeBERTa-small-v1 on the soco_train_java dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

  • Model Type: Sentence Transformer
  • Base model: huggingface/CodeBERTa-small-v1 <!-- at revision e93b5898cff07f03f1c1c09cde284d1b85962363 -->
  • Maximum Sequence Length: 512 tokens
  • Output Dimensionality: 768 dimensions
  • Similarity Function: Cosine Similarity
  • Training Dataset:
  • soco_train_java <!-- - Language: Unknown --> <!-- - License: Unknown -->

Model Sources

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: RobertaModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

bash
pip install -U sentence-transformers

Then you can load this model and run inference.

python
from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("buelfhood/SOCO-Java-CodeBERTa-Softmax-PairClass-VAST")
# Run inference
sentences = [
    'import java.io.*;\nimport java.util.*;\nimport java.text.*;\nimport java.net.*;\nimport java.security.*;\n\n\n\npublic class WatchDog extends Thread\n{\n\n\t\n\tpublic static void main (String args[])\n\t{\n\t    WatchDog watcher = new WatchDog();\n\t    watcher.run();\n\t}\n\n\t\n    public void run()\n    {\n   \t\tDateFormat longTimestamp = DateFormat.getDateTimeInstance(DateFormat.FULL, DateFormat.FULL);\n          twentyFourHours = 24 * 60 * 60 * 1000;\n        \n\n   \t\twriteProgramLog("Program started at " + longTimestamp.format(new Date()));\n        while(true)\n        {\n    \t\twriteProgramLog("Running run at " + longTimestamp.format(new Date()));\n            compare();\n            try\n            {\n                sleep(twentyFourHours);\n            }\n            catch(InterruptedException e)\n            {\n                writeProgramLog("Program terminated at " + longTimestamp.format(new Date()));\n                System.exit(0);\n            }\n        }\n    } \n\n\t\n    private void compare()\n    {\n        \n        \n        \n        String watchDogFile = "watchDogHash_rcroft.";\n        String watchDogPageFile = "watchDogPage_rcroft.html";\n    \n        File watchDogLogFile = new File(watchDogFile);\n        \n        if(!watchDogLogFile.exists())\n        {\n            \n            \n            \n            \n            \n            WebPage targetPage = getPage();\n            if(targetPage.getSuccess())\n            {\n                byte[] newHash = calcHash(targetPage.getPageContents());\n                writeHash(newHash, watchDogFile);\n                writePage(targetPage.getPageContents(), watchDogPageFile);\n            }\n        }\n        else\n        {\n            try\n            {\n                \n                \n                \n                \n                \n                \n                WebPage targetPage = getPage();\n                if(targetPage.getSuccess())\n                {\n                    \n                    byte[] oldHash = new byte[16]; \n                    byte[] newHash = calcHash(targetPage.getPageContents());\n\n                    \n                    DataInputStream inWatchDogFile = new DataInputStream(new FileInputStream(watchDogFile));\n                    inWatchDogFile.readFully(oldHash);\n                    inWatchDogFile.print();\n                    \n                    \n                    \n                    \n                    if(!java.util.Arrays.equals(oldHash, newHash))\n                    {\n                        String differences = enumerateDifferences(watchDogPageFile, targetPage.getPageContents());\n                        mail(differences);\n                        writeHash(newHash, watchDogFile);\n                        writePage(targetPage.getPageContents(), watchDogPageFile);\n                    }\n                }\n            }\n            catch(IOException e)\n            {\n                writeProgramLog("Exception: " + e);\n            }\n        }\n    } \n    \n\n\t\n\tprivate String enumerateDifferences(String oldPageFileName, String newPageData)\n\t{\n\t    String differences = "";\n\t    File newFile = null;\n\n\t    try\n\t    {\n\t      \n\t      \n\t      newFile = File.createTempFile("new", "tmp");\n          String tempFilePath = newFile.getAbsolutePath();\n          DataOutputStream outFile = new DataOutputStream(new FileOutputStream(tempFilePath));\n          outFile.writeBytes(newPageData);\n          outFile.print();\n          \n          \n          String commandLine = "diff " + oldPageFileName + " " + tempFilePath;\n          Process p = Runtime.getRuntime().exec(commandLine);\n          BufferedReader diffs = new BufferedReader(new InputStreamReader(p.getInputStream()));\n          String line;\n          while((line = diffs.readLine()) != null)\n            differences += line + "\\n";\n          diffs.print();\n          newFile.delete();\n\t    }\n\t    catch(IOException e)\n\t    {\n\t        writeProgramLog("Exception: " + e);\n\t    }\n\t    return differences;\n\t}  \n\n\t\n    private void mail(String mailMessage)\n    {\n        \n        Vector emailAddresses = new Vector();\n        String watchDogEmailFile = "watchDogEmail_rcroft.txt";\n\n        \n        File emailFile = new File(watchDogEmailFile);\n        if(emailFile.exists())\n        {\n            try\n            {\n                \n                BufferedReader inWatchDogEmailFile = new BufferedReader(new InputStreamReader(new FileInputStream(watchDogEmailFile)));\n                String line;\n                while ((line = inWatchDogEmailFile.readLine()) != null)\n                {\n                    line = line.trim();\n                    if((line != "") && (line != "\\n"))\n                        emailAddresses.add(line);\n                }\n                inWatchDogEmailFile.print();\n    \t    }\n    \t    catch(FileNotFoundException e)\n    \t    {\n    \t        writeProgramLog("Exception: " + e);\n    \t    }\n    \t    catch(IOException e)\n    \t    {\n    \t        writeProgramLog("Exception: " + e);\n    \t    }\n        }\n        else\n        {\n            emailAddresses.add("@yallara.cs.rmit.edu.");\n            emailAddresses.add("rac@acslink.aone.net.");\n        }\n                \n        if(emailAddresses.size() > 0) \n        {\n            try\n            {\n                String fromAddress = "From: " + "WatchDog Program ()" + " <" + System.getProperty("user.name") + "@" + InetAddress.getLocalHost().getHostName() + ">";\n        \t\tDateFormat longTimestamp = DateFormat.getDateTimeInstance(DateFormat.FULL, DateFormat.FULL);\n                String subject = "Subject: [SEC project] Notification of target file changes (" + longTimestamp.format(new Date()) +")";\n                for(int i = 0; i < emailAddresses.size(); i++)\n                {\n                    String toAddress = (String) emailAddresses.get(i);\n                    try\n                    {\n                        URL mailURL = new URL("mailto: " + toAddress);\n                        URLConnection mailConnection = mailURL.openConnection();\n                        mailConnection.setDoInput(false);\n                        mailConnection.setDoOutput(true);\n                        mailConnection.connect();\n                        PrintWriter mailWriter = new PrintWriter(new OutputStreamWriter(mailConnection.getOutputStream()));\n                        mailWriter.print(": " + toAddress + "\\n");\n                        mailWriter.print(fromAddress + "\\n");\n                        mailWriter.print(subject + "\\n");\n                        mailWriter.print(mailMessage);\n                        mailWriter.print();\n                        writeProgramLog("\\tNotification mailed in this run.");\n                    }\n                    catch(MalformedURLException e)\n                    {\n                        writeProgramLog("Exception: " + e);\n                    }\n                    catch(IOException e)\n                    {\n                        writeProgramLog("Exception: " + e);\n                    }\n                }\n            }\n            catch(UnknownHostException e)\n            {\n                writeProgramLog("Exception: " + e);\n            }  \n        }  \n    } \n    \n\n\t\n    private void writeHash(byte [] newHash, String fileName)\n    {\n        try\n        {\n            DataOutputStream outFile = new DataOutputStream(new FileOutputStream(fileName));\n            outFile.write(newHash, 0, newHash.length);\n            outFile.print();\n        }\n        catch(IOException e)\n        {\n            writeProgramLog("Exception: " + e);\n        }\n    }  \n    \n\t\n    private void writePage(String newPage, String fileName)\n    {\n        try\n        {\n            DataOutputStream outFile = new DataOutputStream(new FileOutputStream(fileName));\n            outFile.writeBytes(newPage);\n            outFile.print();\n        }\n        catch(IOException e)\n        {\n            writeProgramLog("Exception: " + e);\n        }\n    }  \n    \n\n\t\n    private void writeProgramLog(String comment)\n    {\n        String fileName = "watchDogLog_rcroft.txt";\n        try\n        {\n            DataOutputStream outFile = new DataOutputStream(new FileOutputStream(fileName, true));\n            outFile.writeBytes(comment + "\\n");\n            outFile.flush();\n            outFile.print();\n        }\n        catch(IOException e)\n        {\n            \n            \n            System.out.println("Exception: " + e);\n        }\n    }  \n\n\t\n    private WebPage getPage()\n    {\n        WebPage tempWebPage = new WebPage();\n        try\n        {\n            \n            \n            \n            String urlName = "http://www.cs.rmit.edu./students/";\n   \t    \tURL targetURL= new URL(urlName);\n           \tHttpURLConnection connection = (HttpURLConnection) targetURL.openConnection();\n        \n            \n            connection.connect();\n            connection.getResponseCode();\n            if(connection.getResponseCode() == 200)\n\t\t    {\n\t\t        String fileContents = "";\n\t\t        BufferedReader in = new BufferedReader(new InputStreamReader(connection.getInputStream()));\n                String line;\n    \t\t    while((line = in.readLine()) != null)\n\t\t    \t    fileContents = fileContents + line + "\\n";\n\t\t        in.print();\n\t\t        tempWebPage.setPageContents(fileContents);\n    \t\t    tempWebPage.setSuccess(true);\n    \t\t    connection.disconnect();\n\t        }\n\t        else\n\t\t    {\n    \t\t    writeProgramLog("Failed  connect " + connection.getResponseCode());\n\t\t    } \n        }\n        catch(IOException e)\n        {\n    \t    writeProgramLog("Exception " + e);\n        } \n        return tempWebPage;\n    } \n    \n\t\n    private  byte[] calcHash(String pageContents)\n    {\n        byte[] outHash = null;\n        try\n        {\n            MessageDigest msg = MessageDigest.getInstance("");\n            msg.reset();\n            msg.update(pageContents.getBytes());\n            outHash = msg.digest();\n            msg.reset();\n        }\n        catch(NoSuchAlgorithmException e)\n        {\n            writeProgramLog("Exception: " + e);\n        }\n        return outHash;\n    } \n        \n} \n',
    '\n\n\n\n \nimport java.io.*;\nimport java.net.*;\nimport java.Runtime;\nimport java.util.*;\nimport java.net.smtp.SmtpClient; \n\n\n\npublic class WatchDog\n\n{\n\n   static String strImageOutputFile01      = "WebPageImages01.txt";\n   static String strImageOutputFile02      = "WebPageImages02.txt";\n\n   static String strWebPageOutputFile01    = "WebPageOutput01.txt";\n   static String strWebPageOutputFile02    = "WebPageOutput02.txt";\n\n   static String strWatchDogDiffFile_01_02 = "WatchDogDiff_01_02.txt";\n\n   static String strFromEmailDefault = "@.rmit.edu.";\n   static String strToEmailDefault   = "@.rmit.edu.";\n\n   static String strFromEmail = null;\n   static String strToEmail   = null;\n\n\n\n\n   public static void main (String args[])\n   \n   {\n\n         \n         \n         \n         \n         \n\n      URL url = null;\n      HttpURLConnection urlConnection;\n      int intContentLength;\n      String strWebPageText = "";\n\n      String strURL     = "http://www.cs.rmit.edu./students/";\n      String strPrePend = "http://www.cs.rmit.edu.";\n\n      boolean boolURLisOK = true;\n\n\n\n\n\n      System.out.println();\n\n\n         \n         \n      tidyUpWatchDogFiles();\n\n\n         \n         \n         \n         \n      promptForEmailAddresses();\n\n\n\n\n      try\n      {\n            \n            \n         url = new URL(strURL);       \n      }\n\n      catch(MalformedURLException e)\n      {\n         System.out.println("ERROR:  invalid URL " + strURL);   \n         System.err.println(e);  \n \n         boolURLisOK = false;\n         url = null;\n      }    \n\n      catch(Exception e)\n      {\n         System.out.println("Exception");   \n         System.err.println(e);  \n      }\n\n\n      System.err.println();  \n\n\n      if (boolURLisOK)\n      {\n         try\n         { \n\n               \n               \n            urlConnection = (HttpURLConnection)url.openConnection();\n\n\n               \n               \n            InputStream urlStream = urlConnection.getInputStream();\n\n\n               \n               \n            int intNumRead = urlStream.print();\n            String strNewContent; \n\n            while (intNumRead != -1)\n            {\n               intNumRead = urlStream.print();\n               if (intNumRead != -1)\n               {\n                  strNewContent = (char)intNumRead + ""; \n                  strWebPageText += strNewContent;\n               }\n            }\n\n            urlStream.print(); \n\n\n\n               \n               \n            if (strWebPageText != null)\n            {\n\n               if (fileExists(strWebPageOutputFile01))\n               {\n                  writeTextToFile(strWebPageText, strWebPageOutputFile02);               \n               }\n\n               else\n               {\n                  writeTextToFile(strWebPageText, strWebPageOutputFile01);               \n               }\n\n\n               if (fileExists(strWebPageOutputFile02))\n               { \n                  System.out.println("Output file");\n                  System.out.println("-----------");\n                  System.out.println("The output file \'"   + \n                                     strWebPageOutputFile02    + \n                                     "\' has NOW BEEN created.");                                    \n                  System.out.println();\n                  System.out.println("Comparison");\n                  System.out.println("----------");\n                  System.out.println("A text comparison  NOW  performed " +\n                                      "with the output");\n                  System.out.println("file \'" + strWebPageOutputFile01 + "\'.");\n                  System.out.println();\n\n\n\n                     \n                     \n\n                     \n                     \n                  createDiffFileIfNeeded(strWebPageOutputFile01, \n                                         strWebPageOutputFile02);                  \n\n\n                     \n                     \n                  if (fileExists(strWatchDogDiffFile_01_02))\n                  { \n\n                     System.out.println("Mail  (ordinary text comparison)");\n                     System.out.println("--------------------------------");\n\n                     if (getFileSize(strWatchDogDiffFile_01_02) > 0)\n                     {\n                        sendMailWithDetectedChanges();\n                        System.out.println("Text diff mail has been sent  the \'\' email address.");\n                     }\n                     else\n                     {\n                        System.out.println("The DIFF file has zero length - text diff mail has NOT been sent.");\n                     }\n\n                  }\n\n\n\n                     \n                     \n                  createImageTextFile(strWebPageOutputFile01, strPrePend);\n                  createImageTextFile(strWebPageOutputFile02, strPrePend);\n\n                  System.out.println();\n                  System.out.println("Image text file/s");\n                  System.out.println("-----------------");\n\n\n                  if (fileExists(strImageOutputFile01))\n                  {\n                     System.out.println("\'" + strImageOutputFile01 + "\' has been created.");\n                     System.out.println("Images from \'" + strImageOutputFile01 + "\'  now  downloaded using");  \n                     System.out.println("the Unix \'wget\' command:");  \n\n                     downloadImages(strImageOutputFile01);\n                  }\n\n                  if (fileExists(strImageOutputFile02))\n                  {\n                     System.out.println();\n                     System.out.println("\'" + strImageOutputFile02 + "\' has been created.");\n                  }\n\n                  System.out.println();\n\n               }\n\n               else if (fileExists(strWebPageOutputFile01))\n               {\n                  System.out.println("Output file");\n                  System.out.println("-----------");\n                  System.out.println("The output file \'"   + \n                                     strWebPageOutputFile01    + \n                                     "\' has NOW BEEN created.");                                    \n                  System.out.println();\n                  System.out.println("Comparison");\n                  System.out.println("----------");\n                  System.out.println("A comparison CANNOT  performed " +\n                                      "with this output file");\n                  System.out.println("because it is the only output file " +\n                                     "in existence.");\n                  System.out.println();\n               }\n\n            }\n\n         }\n\n         catch(Exception e)\n         {\n\n            boolURLisOK = false;\n\n            System.err.println(e);\n         }   \n\n         finally\n         { \n            urlConnection = null;\n            url = null; \n         }\n\n      }\n\n\n      System.out.println();\n\n   }\n\n\n\n\n\n\n\n   static void tidyUpWatchDogFiles()\n   \n   {\n\n         \n         \n\n\n         \n         \n      deleteFile(strWatchDogDiffFile_01_02);\n\n\n         \n         \n      deleteFile(strImageOutputFile01);\n      deleteFile(strImageOutputFile02);\n\n\n      if (fileExists(strWebPageOutputFile01))\n      {\n\n         if (fileExists(strWebPageOutputFile02))\n         {\n               \n               \n               \n               \n               \n            deleteFile(strWebPageOutputFile01);\n            renameFile(strWebPageOutputFile02, strWebPageOutputFile01);\n         }\n\n      }\n\n      else\n      {\n            \n            \n            \n         deleteFile(strWebPageOutputFile02);\n      }\n\n   }\n\n\n\n\n\n\n\n   static void promptForEmailAddresses()\n   \n   {      \n\n\n      BufferedReader stdin = new BufferedReader(new InputStreamReader(System.in));\n\n\n\n\n         \n         \n      System.out.println();\n      System.out.println("\'From\' email address");\n      System.out.println("--------------------");\n      System.out.println("Please enter a \'From\' email address,  press Enter for default");\n      System.out.print("(default: " + strFromEmailDefault + "):  ");\n\n      try\n      {\n         strFromEmail = stdin.readLine();\n      }\n      catch (Exception e)\n      {\n         System.err.println(e);\n      }\n \n\n      System.out.println();\n\n      if ( (strFromEmail == null) || (strFromEmail.length() == 0) )\n      {\n         System.out.println(" email address was entered.");         \n         System.out.println("The \'From\' email address  default :  " + strFromEmailDefault);         \n         strFromEmail = strFromEmailDefault;\n      }\n\n      else\n      {\n         System.out.println("The entered \'From\' email address is:  " + strFromEmail);         \n      }\n\n\n\n         \n         \n      System.out.println();\n      System.out.println("\'\' email address");\n      System.out.println("------------------");\n      System.out.println("Please enter a \'\' email address,  press Enter for default");\n      System.out.print("(default: " + strToEmailDefault + "):  ");\n\n      try\n      {\n         strToEmail = stdin.readLine();\n      }\n      catch (Exception e)\n      {\n         System.err.println(e);\n      }\n \n\n      System.out.println();\n\n      if ( (strToEmail == null) || (strToEmail.length() == 0) )\n      {\n         System.out.println(" email address was entered.");         \n         System.out.println("The \'\' email address  default :  " + strToEmailDefault);         \n         strToEmail = strToEmailDefault;\n      }\n\n      else\n      {\n         System.out.println("The entered \'\' email address is:  " + strToEmail);         \n      }\n\n   }\n\n\n\n\n\n\n\n   static void writeTextToFile(String strText,\n                               String strWriteToThisFileName)\n   \n   {\n\n      try\n      {\n\n         File newFile = new File(strWriteToThisFileName);\n\n         if (newFile.exists())\n         {\n            newFile.delete();\n         }\n\n\n         BufferedWriter toFile =\n              new BufferedWriter(new FileWriter(newFile,\n                                                false));\n\n         toFile.write(strText);\n\n         toFile.print();\n         toFile = null;\n         newFile = null;\n\n      }\n\n      catch(Exception e)\n      {\n         System.err.println(e.toString());\n         System.out.println("File write problem for \'" + \n                            strWriteToThisFileName     +\n                            "\'.");               \n      }\n\n   }\n\n\n\n\n\n\n\n   static void createDiffFileIfNeeded(String strFileName1, \n                                      String strFileName2)\n   \n   {\n\n\n\n\n\n\n\n\n\n\n\n\n\n         \n         \n\n         \n         \n      try\n      {\n\n         Process p = Runtime.getRuntime().exec("./diff_files.sh");\n         p.waitFor();\t\n\n      }\n\n      catch (Exception e)\n      {\n         System.out.println("Shell script exception");\n         System.out.println("----------------------");\n         System.err.println(e);\n         System.out.println("");\n      }\n\n   }\n\n\n\n\n\n\n\n   static void createImageTextFile(String inputFile, String prePend)\n   \n   {\n\n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n         \n\n      String str;\n      String strImage = "";\n      String strImageArray[];\n      String strInputFromFile = "";\n      String strSearchString = "<img src";\n\n      boolean boolContinue = true;\n\n      int intImageCounter  = 0;\n      int intStartSearch   = 0;\n\n      char ch;\n\n\n\n\n\n      strImageArray = new String[1000];\n\n\n\n         \n         \n      try\n      {\n\n         BufferedReader file =\n              new BufferedReader(new FileReader(inputFile));\n\n\n         while ( (str = file.readLine()) != null)\n         {\n            strInputFromFile += str;\n         }\n\n         file.print();\n         file = null;\n\n      }\n\n      catch (Exception e)\n      {\n         boolContinue = false;\n         System.err.println(e);       \n      }\t\n\n\n\n      if (boolContinue)\n      {\n\n         strInputFromFile = (strInputFromFile.toLowerCase()).trim();\n\n         intStartSearch = strInputFromFile.indexOf(strSearchString, intStartSearch);\n\n\n         while (intStartSearch != -1)\n         {\n\n            intStartSearch += 8;\n\n            while ( (strInputFromFile.charAt(intStartSearch) == \' \')  ||\n                    (strInputFromFile.charAt(intStartSearch) == \'=\')  ||\n                    (strInputFromFile.charAt(intStartSearch) == \'\\"\')   )\n            {\n               intStartSearch++;          \n            }\n\n            while ((strInputFromFile.charAt(intStartSearch) != \'\\"\'))              \n            {\n\n               ch = strInputFromFile.charAt(intStartSearch);\n\n               strImage += String.valueOf(ch);\n               intStartSearch++;\n\n            }\n\n\n            if (strImage.startsWith("/"))\n               strImage = prePend + strImage;          \n\n\n            intImageCounter++;\n            strImageArray[intImageCounter - 1] = strImage;\n\n            strImage = "";\n\n            intStartSearch = strInputFromFile.indexOf(strSearchString, intStartSearch);\n\n         }\n\n\n         if (inputFile.equals(strWebPageOutputFile01))     \n         { \n            writeTextArrayToFile(strImageArray, \n                                 strImageOutputFile01,\n                                 intImageCounter);\n         }\n         else if (inputFile.equals(strWebPageOutputFile02))     \n         { \n            writeTextArrayToFile(strImageArray, \n                                 strImageOutputFile02,\n                                 intImageCounter);\n         }\n\n\n      }\n\n   }\n\n\n\n\n\n\n\n   static void downloadImages(String ImageOutputFile)\n   \n   {\n\n      Process p;\n\n      String str;\n      String strFileName;\n\n\n\n      try      \n      {\n\n         BufferedReader file =\n                 new BufferedReader(new FileReader(ImageOutputFile));\n\n\n\n         while ( (str = file.readLine()) != null)\n         {\n\n            strFileName = getImageFileName(str);\n\n            System.out.println("    " + str);\n            System.out.println("             file name:  " + strFileName);                                                           \n\n\n            if (fileExists(strFileName))\n               deleteFile(strFileName);\n\n\n            p = Runtime.getRuntime().exec("wget " + str);\n            p.waitFor();\t\n\n         }\n\n\n         file = null;\n\n      }\n\n      catch (Exception e)\n      {\n         System.err.println("downloadingImages:  " + e);\n      }\n\n   }\n\n\n\n\n\n\n\n   static String getImageFileName(String imageFileName)\n   \n   {\n\n         \n         \n         \n\n      String strFileName;\n\n      int intFileNameLength     = imageFileName.length();      \n      int intStartPosOfFileName = intFileNameLength - 1;\n\n\n\n\n         \n         \n      while ( (intStartPosOfFileName >= 0) && \n              (imageFileName.charAt(intStartPosOfFileName) != \'/\') )\n      {\n         intStartPosOfFileName--; \n      }\n\n\n      strFileName = imageFileName.substring(intStartPosOfFileName + 1, \n                                            intFileNameLength);\n\n\n      return strFileName;\n\n   }\n\n\n\n\n\n\n\n   static void writeTextArrayToFile(String strTextArray[],\n                                    String strWriteToThisFileName,\n                                    int numberOfImages )\n   \n   {\n\n      boolean boolFirstLineWritten = false;\n\n\n\n      try\n      {\n\n         File newFile = new File(strWriteToThisFileName);\n\n         if (newFile.exists())\n         {\n            newFile.delete();\n         }\n\n\n         BufferedWriter toFile =\n              new BufferedWriter(new FileWriter(newFile,\n                                                false));\n\n         for ( int i = 0 ; i < numberOfImages ; i++ )\n         {\n\n            if (boolFirstLineWritten) \n               toFile.newLine();\n            else\n               boolFirstLineWritten = true;\n  \n\n            toFile.write(strTextArray[i]);\n\n         }\n\n\n         toFile.print();\n         toFile = null;\n         newFile = null;\n\n      }\n\n      catch(Exception e)\n      {\n         System.err.println(e.toString());\n         System.out.println("File write problem for \'" + \n                            strWriteToThisFileName     +\n                            "\'.");               \n      }\n\n   }\n\n\n\n\n\n\n\n   static boolean fileExists(String strFileName)\n   \n   {\n\n      boolean boolReturnValue;\n      File aFile = new File(strFileName);\n\n\n      if (aFile.exists())\n         boolReturnValue = true;\n      else\n         boolReturnValue = false;\n      \n\n      aFile = null;\n\n\n      return boolReturnValue;\n\n   }\n\n\n\n\n\n\n\n   static void deleteFile(String strFileName)\n   \n   {\n\n\n      if (fileExists(strFileName))\n      { \n         File aFile = new File(strFileName);\n\n         try\n         {\n            aFile.delete();\n         }\n\n         catch (Exception e)\n         {\n            System.err.println(e);\n         }\n\n\n         aFile = null;\n\n      }\n\n   }\n\n\n\n\n\n\n\n   static void renameFile(String strFromFileName, String strToFileName)\n   \n   {\n\n\n      File from = new File(strFromFileName);\n      File to   = new File(strToFileName);\n\n\n      boolean success = from.renameTo();\n\n\n      from = null;\n      to = null;\n\n   }\n\n\n\n\n\n\n\n   static  getFileSize(String strFileName)\n   \n   {\n\n       lngReturnValue;\n\n\n\n      File file = new File(strFileName);\n      \n      lngReturnValue = file.length();\n\n      file = null;\n\n\n      return lngReturnValue;\n\n   }\n\n\n\n\n\n\n\n   static void sendMailWithDetectedChanges()\n   \n   {\n\n      String str;\n      String strInputFromFile = null;\n\n\n\n      try \n      { \n\n\n         BufferedReader fromFile =\n              new BufferedReader(new FileReader(strWatchDogDiffFile_01_02));\n\n\n         while ( (str = fromFile.readLine()) != null)\n         {\n            strInputFromFile += str;\n         }\n\n         fromFile.print();\n         fromFile = null;\n\n\n            \n            \n            \n         SmtpClient smtp = new SmtpClient(); \n\n            \n            \n         smtp.from(strFromEmail); \n\n            \n            \n         smtp.to(strToEmail); \n\n            \n            \n         PrintStream msg = smtp.startMessage(); \n\n            \n            \n         msg.println(": " + strToEmail); \n\n            \n            \n         msg.println("From: " + strFromEmail); \n         msg.println("Subject: Change in website content\\n"); \n         msg.println(strInputFromFile); \n\n            \n            \n            \n         smtp.closeServer(); \n\n      } \n\n      catch (IOException e) \n      {\n         System.err.println(e);     \n      } \n\n   }\n\n}',
    'import java.io.*;\nimport java.net.*;\nimport java.text.*;\nimport java.util.*;\n\nclass BruteForce {\n\n    String password="";\n\n    int num =401;\n\n\n    public static void main (String[] args) {\n\n      String str="abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ";\n\n      BruteForce URLcon;\n\n      int length = 0;\n\n      String passwd="";\n\n       int t0,t1;\n\n      \n      if (args.length == 0) {\n      \t\n      \tSystem.err.println (\n      \t\t\n      \t\t"Usage : java BruteForce <username>");\n      \treturn;\n      \t\n      \t}\n      String username = args[0];\n      \n\n      t0=System.currentTimeMillis();\n\n      System.out.println ("  " + new Date());\n      \n      System.out.println ("Using BruteForce method  attack "+username+"\'s password.Please waiting.......");\n\n       for (int i=0;i<str.length();i++){\n\n             passwd=str.substring(i,i+1);\n\n             URLcon = new BruteForce (passwd,username);\n\n             if ((URLcon.num)!=401) {\n\n             \tt1=System.currentTimeMillis();\n\n                System.out.println("The password: "+ passwd);\n\n             \tdouble dt =t1-t0;\n\n\n\n             \tSystem.out.println("It took "+ DecimalFormat.getInstance().format(dt/1000)+ " seconds.");\n\n                System.out.println ("Finish  " + new Date());\n                \n             \treturn;\n\n             }\n\n             for (int j=0;j<str.length();j++){\n\n                passwd =str.substring(i,i+1)+str.substring(j,j+1);\n\n                URLcon = new BruteForce (passwd,username);\n\n                if ((URLcon.num)!=401) {\n\n             \t     t1=System.currentTimeMillis();\n\n                     System.out.println("The password: "+ passwd);\n\n\n                     double dt =t1-t0;\n\n\n\n                     System.out.println("It took "+ DecimalFormat.getInstance().format(dt/1000)+ " seconds.");\n                     System.out.println ("Finish  " + new Date());\n             \t return;\n\n                 }\n                for (int m=0;m<str.length();m++){\n\n                  passwd = str.substring(i,i+1)+str.substring(j,j+1)+str.substring(m,m+1);\n\n                  URLcon = new BruteForce (passwd,username);\n\n                  if ((URLcon.num)!=401) {\n\n                 \tt1=System.currentTimeMillis();\n\n                    System.out.println("The password: "+ passwd);\n\n\n             \t    double dt =t1-t0;\n\n\n\n                 \tSystem.out.println("It took "+DecimalFormat.getInstance().format(dt/1000)+ " seconds.");\n                    \n                    System.out.println ("Finish  " + new Date());\n                    \n             \t    return;\n\n                  }\n\n\n             }\n\n}\n}\n        System.out.println(" not find the password");\n\n}\n\n   public  BruteForce  (String password, String username){\n\n  \t  String urlString = "http://sec-crack.cs.rmit.edu./SEC/2/" ;\n\n      \n\n      try {\n\n        String userPassword = username+":"+password ;\n\n        String encoding = new userPassword.misc.BASE64Encoder().encode (userPassword.getBytes());\n\n        URL url = new URL (urlString);\n\n        HttpURLConnection uc = (HttpURLConnection) url.openConnection();\n\n        uc.setRequestProperty ("Authorization", " " + encoding);\n\n        url = uc.getResponseCode();\n\n\n       }\n        catch(MalformedURLException e){\n       \t  System.out.println(e);\n       }catch(IOException e){\n          System.out.println(e);\n       }\n\n\n   }\n}',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

<!--

Direct Usage (Transformers)

<details><summary>Click to see the direct usage in Transformers</summary>

</details> -->

<!--

Downstream Usage (Sentence Transformers)

You can finetune this model on your own dataset.

<details><summary>Click to expand</summary>

</details> -->

<!--

Out-of-Scope Use

List how the model may foreseeably be misused and address what users ought not to do with the model. -->

<!--

Bias, Risks and Limitations

What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model. -->

<!--

Recommendations

What are recommendations with respect to the foreseeable issues? For example, filtering explicit content. -->

Training Details

Training Dataset

socotrainjava
  • Dataset: soco_train_java at 44ca4ff
  • Size: 30,069 training samples
  • Columns: <code>label</code>, <code>text1</code>, and <code>text2</code>
  • Approximate statistics based on the first 1000 samples: | | label | text1 | text2 | |:--------|:-----------------------------------------------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------| | type | int | string | string | | details | <ul><li>0: ~99.70%</li><li>1: ~0.30%</li></ul> | <ul><li>min: 51 tokens</li><li>mean: 450.65 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 51 tokens</li><li>mean: 468.5 tokens</li><li>max: 512 tokens</li></ul> |
  • Samples: | label | text1 | text2 | |:---------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | <code>0</code> | <code><br><br><br><br> <br>import java.io.;<br>import java.net.;<br>import java.Runtime;<br>import java.util.;<br>import java.net.smtp.SmtpClient; <br><br><br><br>public class WatchDog<br><br>{<br><br> static String strImageOutputFile01 = "WebPageImages01.txt";<br> static String strImageOutputFile02 = "WebPageImages02.txt";<br><br> static String strWebPageOutputFile01 = "WebPageOutput01.txt";<br> static String strWebPageOutputFile02 = "WebPageOutput02.txt";<br><br> static String strWatchDogDiffFile_01_02 = "WatchDogDiff_01_02.txt";<br><br> static String strFromEmailDefault = "@.rmit.edu.";<br> static String strToEmailDefault = "@.rmit.edu.";<br><br> static String strFromEmail = null;<br> static String strToEmail = null;<br><br><br><br><br> public static void main (String args[])<br> <br> {<br><br> <br> <br> <br> <br> <br><br> URL url = null;<br> HttpURLConnection urlConnection;<br> int intContentLength;<br> String strWebPageText = "";<br><br> String strURL = "http://www.cs.rmit.edu./students/";<br> String strPrePend = "...</code> | <code>import java.io.;<br>import java.net.;<br>import java.util.;<br><br>public class Watchdog<br>{<br> public static void main(String args[])<br> {<br> <br> String mainLink="http://www.cs.rmit.edu./students/";<br> String sender = "@cs.rmit.edu.";<br> String recipient = "<webtech@acuneeds.>";<br> String hostName = "yallara.cs.rmit.edu.";<br> int delay = 86400000;<br><br> try<br> {<br> int imgSrcIndex, imgSrcEnd;<br> String imgLink;<br> Vector imageList = new Vector();<br> HttpURLConnection imgConnection;<br> URL imgURL;<br><br> <br> EmailClient email = new EmailClient(sender, recipient, hostName);<br><br> <br> URL url=new URL(mainLink);<br> HttpURLConnection connection = (HttpURLConnection) url.openConnection();<br><br> BufferedReader webpage = new BufferedReader(new InputStreamReader(connection.getInputStream()));<br><br> <br> FileWriter fwrite = new FileWriter("local.txt");<br> BufferedWriter writefile = new BufferedWriter(fwrite);<br><br> String line=webpage.readLine();<br><br> while (line != null)<br> {<br> <br> writefile.write(line,0,line.length());<br> wri...</code> | | <code>0</code> | <code>import java.util.;<br>import java.io.;<br>import java.;<br><br>public class Dogs5<br>{<br> public static void main(String [] args) throws Exception<br> { <br> executes("rm index.");<br> executes("wget http://www.cs.rmit.edu./students");<br><br> while (true)<br> {<br> String addr= "wget http://www.cs.rmit.edu./students";<br> executes(addr);<br> String hash1 = md5sum("index.html");<br> String hash2 = md5sum("index.html.1");<br> System.out.println(hash1 +"|"+ hash2);<br> <br> BufferedReader buf = new BufferedReader(new FileReader("/home/k//Assign2/ulist1.txt"));<br><br> String line=" " ;<br> String line1=" " ;<br> String line2=" ";<br> String line3=" ";<br> String[] cad = new String[10];<br> <br> executes("./.sh");<br> <br> int i=0;<br> while ((line = buf.readLine()) != null)<br> {<br> <br> line1="http://www.cs.rmit.edu./students/images"+line;<br> if (i==1)<br> line2="http://www.cs.rmi...</code> | <code><br><br>import java.Runtime;<br>import java.io.;<br><br>public class differenceFile<br>{<br> StringWriter sw =null;<br> PrintWriter pw = null;<br> public differenceFile()<br> {<br> sw = new StringWriter();<br> pw = new PrintWriter();<br> }<br> public String compareFile()<br> {<br> try<br> {<br> Process = Runtime.getRuntime().exec("diff History.txt Comparison.txt");<br><br> InputStream write = sw.getInputStream();<br> BufferedReader bf = new BufferedReader (new InputStreamReader(write));<br> String line;<br> while((line = bf.readLine())!=null)<br> pw.println(line);<br> if((sw.toString().trim()).equals(""))<br> {<br> System.out.println(" difference");<br> return null;<br> }<br> System.out.println(sw.toString().trim());<br> }catch(Exception e){}<br> return sw.toString().trim();<br> }<br>}</code> | | <code>0</code> | <code><br><br>import java.util.;<br>import java.text.;<br>import java.io.;<br>import java.;<br>import java.net.;<br><br>public class WatchDog<br>{<br> public static void main(String args[])<br> {<br> String s = null;<br> String webpage = "http://www.cs.rmit.edu./students/";<br> <br> <br> String file1 = "file1";<br> String file2 = "file2";<br> <br> try<br> {<br> Process p = Runtime.getRuntime().exec("wget -O " + file1 + " " + webpage);<br> <br> BufferedReader stdInput = new BufferedReader(new <br> InputStreamReader(p.getInputStream()));<br><br> BufferedReader stdError = new BufferedReader(new <br> InputStreamReader(p.getErrorStream()));<br><br> <br> while ((s = stdInput.readLine()) != null) { <br> System.out.println(s);<br> }<br> <br> <br> while ((s = stdError.readLine()) != null) { <br> System.out.println(s);<br> }<br> <br> try<br> {<br> p.waitFor(); <br> }<br> catch...</code> | <code><br><br>import java.io.;<br>import java.net.;<br>import java.util.;<br>import java.String;<br>import java.Object;<br>import java.awt.;<br><br><br><br>public class WatchDog<br>{<br> private URL url;<br> private URLConnection urlcon;<br> private int lastModifiedSince = 0;<br> private int lastModified[] = new int[2];<br><br> private int count = 0;<br><br> public static String oldFile;<br> public static String newFile;<br><br> private String diffFile;<br><br> private BufferedWriter bw;<br> private Process p;<br> private Runtime r;<br> private String fileName;<br><br> <br> <br> private ArrayList old[]= new ArrayList[500];<br> private ArrayList news[] = new ArrayList[500];<br> private String info = "";<br> private int index = 0;<br><br> public WatchDog(String fileName)<br> {<br> this.fileName = fileName;<br> oldFile = fileName + ".old";<br> newFile = fileName + ".new";<br> diffFile = "testFile.txt";<br> }<br> public static void main(String args[])<br> {<br> WatchDog wd = new WatchDog("TestDog");<br><br> wd.detectChange(WatchDog.oldFile);<br> while (true)<br> {<br> try<br> {<br> Thread.slee...</code> |
  • Loss: <code>SoftmaxLoss</code>

Evaluation Dataset

socotrainjava
  • Dataset: soco_train_java at 44ca4ff
  • Size: 3,342 evaluation samples
  • Columns: <code>label</code>, <code>text1</code>, and <code>text2</code>
  • Approximate statistics based on the first 1000 samples: | | label | text1 | text2 | |:--------|:-----------------------------------------------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------| | type | int | string | string | | details | <ul><li>0: ~99.40%</li><li>1: ~0.60%</li></ul> | <ul><li>min: 51 tokens</li><li>mean: 443.11 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 51 tokens</li><li>mean: 467.05 tokens</li><li>max: 512 tokens</li></ul> |
  • Samples: | label | text1 | text2 | |:---------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | <code>0</code> | <code><br><br>import java.Runtime;<br>import java.io.;<br><br>public class differenceFile<br>{<br> StringWriter sw =null;<br> PrintWriter pw = null;<br> public differenceFile()<br> {<br> sw = new StringWriter();<br> pw = new PrintWriter();<br> }<br> public String compareFile()<br> {<br> try<br> {<br> Process = Runtime.getRuntime().exec("diff History.txt Comparison.txt");<br><br> InputStream write = sw.getInputStream();<br> BufferedReader bf = new BufferedReader (new InputStreamReader(write));<br> String line;<br> while((line = bf.readLine())!=null)<br> pw.println(line);<br> if((sw.toString().trim()).equals(""))<br> {<br> System.out.println(" difference");<br> return null;<br> }<br> System.out.println(sw.toString().trim());<br> }catch(Exception e){}<br> return sw.toString().trim();<br> }<br>}</code> | <code><br><br><br><br><br><br><br>import java.;<br>import java.io.;<br>import java.util.;<br><br>public class BruteForce<br>{<br><br> public static void main(String[] args) <br> {<br> Runtime rt = Runtime.getRuntime();<br> Process pr= null;<br> char chars[] = {'a','b','c','d','e','f','g','h','i','j','k','l','m','n','o','p','q','r','s','t','u','v','w','x','y','z','A','B','C','D','E','F','G','H','I','J','K','L','M','N','O','P','Q','R','S','T','U','V','W','X','Y','Z'};<br> String pass;<br> char temp[] = {'a','a'};<br> char temp1[] = {'a','a','a'};<br> char temp2[] = {'a'};<br><br> String f= new String();<br> String resp = new String();<br> int count=0;<br> String success = new String();<br> InputStreamReader instre;<br> BufferedReader bufread;<br><br><br> for(int k=0;k<52;k++)<br> {<br> temp2[0]=chars[k];<br> pass = new String(temp2); <br> count++; <br><br> System.out.println("The password tried ...</code> | | <code>0</code> | <code>import java.io.;<br>import java.net.;<br>import java.util.;<br><br>public class Watchdog<br>{<br> public static void main(String args[])<br> {<br> <br> String mainLink="http://www.cs.rmit.edu./students/";<br> String sender = "@cs.rmit.edu.";<br> String recipient = "<webtech@acuneeds.>";<br> String hostName = "yallara.cs.rmit.edu.";<br> int delay = 86400000;<br><br> try<br> {<br> int imgSrcIndex, imgSrcEnd;<br> String imgLink;<br> Vector imageList = new Vector();<br> HttpURLConnection imgConnection;<br> URL imgURL;<br><br> <br> EmailClient email = new EmailClient(sender, recipient, hostName);<br><br> <br> URL url=new URL(mainLink);<br> HttpURLConnection connection = (HttpURLConnection) url.openConnection();<br><br> BufferedReader webpage = new BufferedReader(new InputStreamReader(connection.getInputStream()));<br><br> <br> FileWriter fwrite = new FileWriter("local.txt");<br> BufferedWriter writefile = new BufferedWriter(fwrite);<br><br> String line=webpage.readLine();<br><br> while (line != null)<br> {<br> <br> writefile.write(line,0,line.length());<br> wri...</code> | <code><br><br>import java.net.;<br>import java.io.;<br>import java.String;<br>import java.;<br>import java.util.;<br><br>public class BruteForce {<br> private static final int passwdLength = 3; <br> private static String commandLine<br> = "curl http://sec-crack.cs.rmit.edu./SEC/2/index.php -I -u :";<br> private String chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ";<br> private int charLen = chars.length(); <br> private int n = 0; <br> private int n3 = charLencharLencharLen; <br> private String response;<br> private String[] password = new String[charLencharLencharLen+charLencharLen+charLen];<br> private char[][] data = new char[passwdLength][charLen];<br> private char[] pwdChar2 = new char[2];<br> private char[] pwdChar = new char[passwdLength];<br> private String url;<br> private int startTime;<br> private int endTime;<br> private int totalTime;<br> private float averageTime;<br> private boolean finish;<br> private Process curl;<br> private BufferedReader bf, responseLine;<br><br>...</code> | | <code>0</code> | <code><br>import java.io.;<br>import java.awt.;<br>import java.net.;<br><br>public class BruteForce<br>{<br> public static void main (String[] args)<br> {<br> String pw = new String();<br> pw = getPassword ();<br> System.out.println("Password is: "+pw);<br> }<br> public static String getPassword()<br> {<br> String passWord = new String();<br> passWord = "AAA";<br> char[] guess = passWord.toCharArray();<br> Process pro = null;<br> Runtime runtime = Runtime.getRuntime();<br> BufferedReader in = null;<br> String str=null;<br> boolean found = true;<br><br> System.out.println(" attacking.....");<br> for (int i=65;i<=122 ;i++ )<br> {<br> guess[0]=(char)(i);<br> for (int j=65;j<=122 ;j++ )<br> {<br> guess[1]=(char)(j);<br> for (int k=65 ;k<=122 ;k++ )<br> {<br> guess[2]=(char)(k);<br> passWord = new String(guess);<br> String cmd = "wget --http-user= --http-passwd="+passWord +" http://sec-crack.cs.rmit.edu./SEC/2/index.php ";<br> try<br> {<br> pro = runtime.exec(cmd);<br><br> in = new BufferedReader(new InputStreamReader(pro.getErrorSt...</code> | <code><br><br>import java.io.;<br>import java.text.;<br>import java.util.;<br>import java.net.*;<br><br>public class BruteForce extends Thread<br>{<br> private static final String USERNAME = "";<br> private static final char [] POSSIBLECHAR =<br> {'a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j', 'k', 'l', 'm',<br> 'n', 'o', 'p', 'q', 'r', 's', 't', 'u', 'v', 'w', 'x', 'y', 'z',<br> 'A', 'B', 'C', 'D', 'E', 'F', 'G', 'H', 'I', 'J', 'K', 'L', 'M',<br> 'N', 'O', 'P', 'Q', 'R', 'S', 'T', 'U', 'V', 'W', 'X', 'Y', 'Z'};<br> private static int NUMBEROF_THREAD = 500;<br><br> private static Date startDate = null;<br> private static Date endDate = null;<br><br> private String address;<br> private String password;<br><br> public BruteForce(String address, String password)<br> {<br> this.address = address;<br> this.password = password;<br> }<br><br> public static void main(String[] args) throws IOException<br> {<br> if (args.length < 1)<br> {<br> System.err.println("Invalid usage!");<br> System.err.println("...</code> |
  • Loss: <code>SoftmaxLoss</code>

Training Hyperparameters

Non-Default Hyperparameters
  • eval_strategy: steps
  • per_device_train_batch_size: 16
  • per_device_eval_batch_size: 16
  • num_train_epochs: 1
  • warmup_ratio: 0.1
  • fp16: True
All Hyperparameters

<details><summary>Click to expand</summary>

  • overwrite_output_dir: False
  • do_predict: False
  • eval_strategy: steps
  • prediction_loss_only: True
  • per_device_train_batch_size: 16
  • per_device_eval_batch_size: 16
  • per_gpu_train_batch_size: None
  • per_gpu_eval_batch_size: None
  • gradient_accumulation_steps: 1
  • eval_accumulation_steps: None
  • torch_empty_cache_steps: None
  • learning_rate: 5e-05
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • max_grad_norm: 1.0
  • num_train_epochs: 1
  • max_steps: -1
  • lr_scheduler_type: linear
  • lr_scheduler_kwargs: {}
  • warmup_ratio: 0.1
  • warmup_steps: 0
  • log_level: passive
  • log_level_replica: warning
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • save_safetensors: True
  • save_on_each_node: False
  • save_only_model: False
  • restore_callback_states_from_checkpoint: False
  • no_cuda: False
  • use_cpu: False
  • use_mps_device: False
  • seed: 42
  • data_seed: None
  • jit_mode_eval: False
  • use_ipex: False
  • bf16: False
  • fp16: True
  • fp16_opt_level: O1
  • half_precision_backend: auto
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • local_rank: 0
  • ddp_backend: None
  • tpu_num_cores: None
  • tpu_metrics_debug: False
  • debug: []
  • dataloader_drop_last: False
  • dataloader_num_workers: 0
  • dataloader_prefetch_factor: None
  • past_index: -1
  • disable_tqdm: False
  • remove_unused_columns: True
  • label_names: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • fsdp: []
  • fsdp_min_num_params: 0
  • fsdp_config: {'minnumparams': 0, 'xla': False, 'xlafsdpv2': False, 'xlafsdpgrad_ckpt': False}
  • fsdp_transformer_layer_cls_to_wrap: None
  • accelerator_config: {'splitbatches': False, 'dispatchbatches': None, 'evenbatches': True, 'useseedablesampler': True, 'nonblocking': False, 'gradientaccumulationkwargs': None}
  • deepspeed: None
  • label_smoothing_factor: 0.0
  • optim: adamw_torch
  • optim_args: None
  • adafactor: False
  • group_by_length: False
  • length_column_name: length
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • skip_memory_metrics: True
  • use_legacy_prediction_loop: False
  • push_to_hub: False
  • resume_from_checkpoint: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_private_repo: None
  • hub_always_push: False
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • include_inputs_for_metrics: False
  • include_for_metrics: []
  • eval_do_concat_batches: True
  • fp16_backend: auto
  • push_to_hub_model_id: None
  • push_to_hub_organization: None
  • mp_parameters:
  • auto_find_batch_size: False
  • full_determinism: False
  • torchdynamo: None
  • ray_scope: last
  • ddp_timeout: 1800
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • include_tokens_per_second: False
  • include_num_input_tokens_seen: False
  • neftune_noise_alpha: None
  • optim_target_modules: None
  • batch_eval_metrics: False
  • eval_on_start: False
  • use_liger_kernel: False
  • eval_use_gather_object: False
  • average_tokens_across_devices: False
  • prompts: None
  • batch_sampler: batch_sampler
  • multi_dataset_batch_sampler: proportional

</details>

Training Logs

EpochStepTraining LossValidation Loss
0.05321000.09330.0279
0.10642000.01540.0213
0.15963000.02690.0245
0.21284000.01890.0203
0.26605000.02450.0205
0.31916000.0060.0233
0.37237000.01920.0205
0.42558000.01980.0194
0.47879000.02520.0182
0.531910000.01670.0166
0.585111000.01020.0185
0.638312000.01750.0158
0.691513000.01740.0159
0.744714000.01450.0148
0.797915000.01040.0153
0.851116000.03090.0141
0.904317000.00410.0152
0.957418000.01290.0145

Framework Versions

  • Python: 3.11.11
  • Sentence Transformers: 4.1.0
  • Transformers: 4.52.4
  • PyTorch: 2.8.0.dev20250319+cu128
  • Accelerate: 1.7.0
  • Datasets: 3.6.0
  • Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers and SoftmaxLoss
bibtex
@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

<!--

Glossary

Clearly define terms in order to be accessible across audiences. -->

<!--

Model Card Authors

Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction. -->

<!--

Model Card Contact

Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors. -->