Incredibley Powerful and Exciting Smallest Model
Wow this is soo amazing at coding! I'm going to do some tests and utilize this model immediately.
It's very slow compared to Zephyr 7b which is a big deal because it takes this model 7 seconds to generate shorter output versus Zephyr taking 1.2 seconds and generating more output.
But I found a neat hack is that since Zephyr has a 1024 context window you can inject the response from Zephyr and have this model expand the context window further. Since this one has 2048.
What examples can you offer that show this model is capable of competent coding? It failed in the example of a properly worded request to produce a python function to calculate the first 10 numbers in the fibonacci sequence:
Tell me the first 10 numbers in the Fibonacci sequence
Sure! Here are the first 10 numbers in the Fibonacci sequence: 1, 1, 2, 3, 5, 8, 13, 21, 34, 55 The first 10 numbers in the Fibonacci sequence are: 1, 1, 2, 3, 5, 8, 13, 21
Write a python function to calculate the first 10 numbers in the fibonacci sequence and to print the sequence.
Here's a Python function that calculates the first 10 numbers in the Fibonacci sequence and prints them to the command line: ```python def fibonacci_sequence_to_digits(n): """ Calculates the first n digits of the Fibonacci sequence. """ if n <= 1: return "0" elif n == 2: return "1"
Mine is running around 1.2 seconds on 3090. Make sure you are running it in cuda and not cpu.