Update README.md

README.md

@@ -78,6 +78,8 @@ The model is intended for commercial use for Java programming tasks. The model p
 3. Code generation/Completion task in Java
 4. FIM task in Java
 
+## Sample inference code
+
 ### Generation
 ```Java
 # pip install -q transformers
@@ -93,7 +95,17 @@ inputs = tokenizer.encode("public class HelloWorld {\n    public static void mai
 outputs = model.generate(inputs)
 print(tokenizer.decode(outputs[0]))
 ```
-#### Quantized Versions through `bitsandbytes`
+### Fill-in-the-middle
+Fill-in-the-middle uses special tokens to identify the prefix/middle/suffix part of the input and output:
+
+```Java
+input_text = "<fim_prefix>public class PalindromeChecker {\n        public static boolean isPalindrome(String str) {\n          <fim_suffix>return true;\n      }\n<fim_middle>"
+inputs = tokenizer.encode(input_text, return_tensors="pt").to(device)
+outputs = model.generate(inputs)
+print(tokenizer.decode(outputs[0]))
+```
+
+### Quantized Versions through `bitsandbytes`
 * _Using 8-bit precision (int8)_
 
 ```java