Skip to content

Commit 7b393bc

Browse files
tannewttannewt
committed
Merge tag 'v1.9.3'
Introduction of ports subdirectory where all ports are moved to The main change in this release is the introduction of a "ports/" subdirectory at the top-level of the repository, and all of the ports are moved here. In the process the "stmhal" port is renamed to "stm32" to better reflect the MCU that it targets. In addition, the STM32 CMSIS and HAL sources are moved to a new submodule called "stm32lib". The bytecode has changed in this release, compared to the previous release, and as a consequence the .mpy version number has increased to version 3. This means that scripts compiled with the previous mpy-cross must be recompiled to work with this new version. There have also been various enhancements and optimisations, such as: check for valid UTF-8 when creating str objects, support for reverse special binary operations like __radd__, full domain checking in the math module, support for floor-division and modulo in the viper emitter, and addition of stack overflow checking when executing a regex. The stm32 port sees improved support for F7 MCUs, addition of a new board B_L475E_IOT01A based on the STM32L475, and support for the Wiznet W5500 chipset along with improved socket behaviour. A detailed list of changes follows. py core: - objstr: startswith, endswith: check arg to be a string - nlrx86,x64: replace #define of defined() with portable macro usage - objtype: handle NotImplemented return from binary special methods - objtype: mp_obj_class_lookup: improve debug logging - map: remove unused new/free functions - make m_malloc_fail() have void return type, since it doesn't return - modstruct: in struct.pack, stop converting if there are no args left - modstruct: check and prevent buffer-read overflow in struct unpacking - modstruct: check and prevent buffer-write overflow in struct packing - nlrthumb: get working again on standard Thumb arch (ie not Thumb2) - objfloat: fix binary ops with incompatible objects - obj: fix comparison of float/complex NaN with itself - objtype: implement fallback for instance inplace special methods - objtuple: properly implement comparison with incompatible types - objstr: add check for valid UTF-8 when making a str from bytes - objlist: properly implement comparison with incompatible types - runtime0.h: move relational ops to the beginning of mp_binary_op_t - runtime0.h: move MP_BINARY_OP_DIVMOD to the end of mp_binary_op_t - objtype: make sure mp_binary_op_method_name has full size again - runtime0.h: put inplace arith ops in front of normal operations - builtinhelp: simplify code slightly by extracting object type - runtime: implement dispatch for "reverse op" special methods - nlrx86: fix building for Android/x86 - builtinhelp: change signature of help text var from pointer to array - runtime.h: change empty mp_warning macro so var-args are non empty - modbuiltins: implement abs() by dispatching to MP_UNARY_OP_ABS - {objfloat,objcomplex}: optimise MP_UNARY_OP_ABS by reusing variables - mpconfig.h: add note that using computed gotos in VM is not C99 - objstr: strip: don't strip "\0" by default - objexcept: prevent infinite recursion when allocating exceptions - stream: remove unnecessary checks for NULL return from vstr_add_len - vstr: raise a RuntimeError if fixed vstr buffer overflows - vm: use lowercase letter at start of exception message - persistentcode: define mp_raw_code_save_file() for any unix target - add config option to print warnings/errors to stderr - objfloat: support raising a negative number to a fractional power - objset: simplify set and frozenset by separating their locals dicts - objset: check that RHS of a binary op is a set/frozenset - objset: include the failed key in a KeyError raised from set.remove - objtype: change type of enum-to-qstr table to uint16_t to save space - objstr: make empty bytes object have a null-terminating byte - mpprint: only check for null string printing when NDEBUG not defined - objtype: clean up unary- and binary-op enum-to-qstr mapping tables - persistentcode: bump .mpy version number to version 3 - bc: update opcode_format_table to match the bytecode - modmath: add full checks for math domain errors - modmath: convert log2 macro into a function - formatfloat: don't print the negative sign of a NaN value - formatfloat: use standard isinf, isnan funcs instead of custom ones - modbuiltins: use existing utf8_get_char helper in builtin ord func - emitnative: implement floor-division and modulo for viper emitter - objtype: use CPython compatible method name for sizeof - objtype: fit qstrs for special methods in byte type - objtype: define all special methods if requested - objtype: introduce MICROPY_PY_ALL_INPLACE_SPECIAL_METHODS extmod: - modubinascii: only include uzlib/tinf.h when it's really needed - modussl_mbedtls: allow to compile with MBEDTLS_DEBUG_C disabled - machine_pinbase: put PinBase singleton in ROM - re1.5: upgrade to v0.8.2, adds hook for stack overflow checking - modure: add stack overflow checking when executing a regex - uos_dupterm: update uos.dupterm() and helper funcs to have index - uos_dupterm: swallow any errors from dupterm closing the stream - vfs: replace VLA in proxy func with small, static sized array - modussl: add finaliser support for ussl objects - modussl_mbedtls: allow to compile with unix coverage build lib: - add new submodule, stm32lib containing STM32 CMSIS and HAL source - embed/abort_: use mp_raise_msg helper function - libm: fix tanhf so that it correctly handles +/- infinity args - libm: remove implementation of log2f, use MP_NEED_LOG2 instead - axtls: update, support for SSL_EAGAIN return code - berkeley-db-1.xx: update, allow to override MINCACHE, DEFPSIZE drivers: - memory/spiflash: change from hard-coded soft SPI to generic SPI - display/ssd1306.py: improve performance of graphics methods - nrf24l01: make nRF24L01 test script more portable - display/ssd1306: implement SSD1306_I2C poweron method - display/ssd1306: make poweron() work the same with SSD1306_SPI - wiznet5k: improve the performance of socket ops with threading - wiznet5k: get low-level W5500 driver working tools: - upip: upgrade to 1.2.2 - pyboard: use repr() when quoting data in error messages - pyboard: update docstring for additional device support tests: - object_new: better messages, check user __new__() method - class_new: add checks for __init__ being called and other improvements - class_new: add another testcase for __new__/__init__ interaction - class_inplace_op: test for inplace op fallback to normal one - run-bench-tests: update locations of executables, now in ports/ - class_reverse_op: test for reverse arith ops special methods - run-tests: skip class_inplace_op for minimal profile - run-tests: fix copy-paste mistake in var name - cpydiff: add cases for locals() discrepancies - extmod: add test for ure regexes leading to infinite recursion - extmod: add test for '-' in character class in regex - run-tests: close device under test using "finally" - net_inet: update tls test to work with CPython and incl new site unix port: - rename modsocket.c to modusocket.c - modusocket: remove #if MICROPY_SOCKET_EXTRA code blocks - enable MICROPY_PY_REVERSE_SPECIAL_METHODS stm32 port: - modmachine: make machine.bootloader() work when MPU is enabled - modmachine: improve support for sleep/deepsleep on F7 MCUs - compute PLL freq table during build instead of at run time - modmachine: for F7 MCU, save power by reducing internal volt reg - boards/pllvalues.py: make script work with both Python 2 and 3 - Makefile: use lib/stm32lib instead of local cmsis and hal files - remove cmsis and hal files, they are now a submodule - Makefile: automatically fetch stm32lib submodule if needed - update to new STM Cube HAL library - fix clock initialisation of L4 MCUs - rename stmhal port directory to stm32 - remove unused usbd_msc.c file - boards: change remaining stm32f4xx_hal_conf.h to unix line ending - boards: change linker scripts to use "K" instead of hex byte size - boards: fix I2C1 pin mapping on NUCLEO_F401RE/F411RE boards - i2c: when scanning for I2C devices only do 1 probe per address - modnwwiznet5k: release the GIL on blocking network operations - boards: add new board B_L475E_IOT01A based on STM32L475 - make-stmconst.py: make sure mpz const data lives in ROM - timer: make pyb.Timer() instances persistent - mpconfigport.h: add configuration for max periphs on L4 series - usbdev: make the USBD callback struct const so it can go in ROM - usbdev: change static function variable to non-static - usbdev: put all CDC state in a struct - usbdev: put all HID state in a struct - usbdev: simplify CDC tx/rx buffer passing - usbdev: simplify HID tx/rx buffer passing - usbdev/core: add state parameter to all callback functions - usbdev: put all state for the USB device driver in a struct - usbdev: simplify pointers to MSC state and block dev operations - usbdev: merge all global USB device state into a single struct - usbdev: make device descriptor callbacks take a state pointer - usbdev: move all the USB device descriptor state into its struct - timer: enable ARPE so that timer freq can be changed smoothly - modnwwiznet5k: get the IP address of an established socket - boards: fix typos in stm32f767_af.csv table - usbd_cdc_interface: don't reset CDC output buf on initialisation - modnwwiznet5k: implement WIZNET5K.isconnected() method - modusocket: make getaddrinfo() work when passed an IP address - modusocket: return OSError(-2) if getaddrinfo fails - mpconfigport.h: add MICROPY_THREAD_YIELD() macro - modnwwiznet5k: add support for W5500 Ethernet chip - modnwwiznet5k: increase SPI bus speed to 42MHz - modnwwiznet5k: implement stream ioctl for the Wiznet driver - mphalport: improve efficiency of mp_hal_stdout_tx_strn_cooked - make uos.dupterm() conform to specs by using extmod version cc3200 port: - enable micropython.kbd_intr() method - use standard implementation of keyboard interrupt esp8266 port: - rename axtls_helpers.c to posix_helpers.c - posix_helpers: set ENOMEM on memory alloc failure - set DEFPSIZE=1024, MINCACHE=3 for "btree" module - esp_mphal: send data in chunks to mp_uos_dupterm_tx_strn - modnetwork: add "bssid" keyword arg to WLAN.connect() method - modules/webrepl_setup: add info about allowed password length zephyr port: - Makefile: revamp "test" target after ports were moved to ports/ - use CONFIG_NET_APP_SETTINGS to setup initial network addresses - switch to interrupt-driven pull-style console pic16bit port: - add definition of SEEK_SET to unistd.h docs: - pyboard/tutorial: add "timeout=0" to UART in pass-through example - more xrefs to "MicroPython port" in glossary - library/network: fix ref to "socket" module (should be "usocket") - machine.Signal: improve style/grammar and add usage example - library: add description of "index" parameter to uos.dupterm() - library/micropython: fix typo in RST formatting - library/framebuf.rst: generalise constructor to all colour formats - btree: describe page caching policy of the underlying implementation - esp8266/tutorial: update neopixel with example of using 4 bbp - library/network: clarify usage of "bssid" arg in connect() method - pyboard/quickref: add info for Switch, RTC, CAN, Accel classes - pyboard/tutorial: update now that yellow LED also supports PWM - esp8266/quickref: add quickref info for RTC class - library: add missing cross-ref links for classes in pyb module - library/network: update docs to state that W5500 is supported - uselect: document one-shot polling mode - usocket: elaborate descriptions - usocket: document inet_ntop(), inet_pton() - library/network: add dhcp_hostname parameter - reference/isr_rules: minor typo correction - ussl: fix module name refs and use "MicroPython port" term - esp8266/general: add section on TLS limitations - usocket: document that settimeout() isn't supported by all ports - ure: add "|" (alternative) to the list of supported operators - reference/isr_rules.rst: add tutorial on use of micropython.schedule() travis: - use --upgrade when pip is installing cpp-coveralls - update build command now that stm32 Wiznet config has changed examples: - hwconfig_console: add .on()/.off() methods all: - convert mp_uint_t to mp_unary_op_t/mp_binary_op_t where appropriate - convert remaining "mp_uint_t n_args" to "size_t n_args" - make new ports/ sub-directory and move all ports there - update Makefiles and others to build with new ports/ dir layout - remove inclusion of internal py header files - use NULL instead of "" when calling mp_raise exception helpers README: - update "Dependencies" section - add explicit section on contributing - add gcc and arm-none-eabi-newlib to list of required components .gitattributes: - remove obsolete entries for stmhal/hal, stmhal/cmsis - add entries for files that will move to ports/ dir
2 parents 3cfb060 + fe45d78 commit 7b393bc

File tree

105 files changed

+1007
-477
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

105 files changed

+1007
-477
lines changed

‎docs/esp8266/general.rst

Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -145,3 +145,43 @@ or by an exeption, for example using try/finally::
145145
# Use sock
146146
finally:
147147
sock.close()
148+
149+
150+
SSL/TLS limitations
151+
~~~~~~~~~~~~~~~~~~~
152+
153+
ESP8266 uses `axTLS <http://axtls.sourceforge.net/>`_ library, which is one
154+
of the smallest TLS libraries with the compatible licensing. However, it
155+
also has some known issues/limitations:
156+
157+
1. No support for Diffie-Hellman (DH) key exchange and Elliptic-curve
158+
cryptography (ECC). This means it can't work with sites which force
159+
the use of these features (it works ok with classic RSA certifactes).
160+
2. Half-duplex communication nature. axTLS uses a single buffer for both
161+
sending and receiving, which leads to considerable memory saving and
162+
works well with protocols like HTTP. But there may be problems with
163+
protocols which don't follow classic request-response model.
164+
165+
Besides axTLS own limitations, the configuration used for MicroPython is
166+
highly optimized for code size, which leads to additional limitations
167+
(these may be lifted in the future):
168+
169+
3. Optimized RSA algorithms are not enabled, which may lead to slow
170+
SSL handshakes.
171+
4. Stored sessions are not supported (may allow faster repeated connections
172+
to the same site in some circumstances).
173+
174+
Besides axTLS specific limitations described above, there's another generic
175+
limitation with usage of TLS on the low-memory devices:
176+
177+
5. The TLS standard specifies the maximum length of the TLS record (unit
178+
of TLS communication, the entire record must be buffered before it can
179+
be processed) as 16KB. That's almost half of the available ESP8266 memory,
180+
and inside a more or less advanced application would be hard to allocate
181+
due to memory fragmentation issues. As a compromise, a smaller buffer is
182+
used, with the idea that the most interesting usage for SSL would be
183+
accessing various REST APIs, which usually require much smaller messages.
184+
The buffers size is on the order of 5KB, and is adjusted from time to
185+
time, taking as a reference being able to access https://google.com .
186+
The smaller buffer hower means that some sites can't be accessed using
187+
it, and it's not possible to stream large amounts of data.

‎docs/esp8266/quickref.rst

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -223,6 +223,17 @@ and is accessed via the :ref:`machine.I2C <machine.I2C>` class::
223223
buf = bytearray(10) # create a buffer with 10 bytes
224224
i2c.writeto(0x3a, buf) # write the given buffer to the slave
225225

226+
Real time clock (RTC)
227+
---------------------
228+
229+
See :ref:`machine.RTC <machine.RTC>` ::
230+
231+
from machine import RTC
232+
233+
rtc = RTC()
234+
rtc.datetime((2017, 8, 23, 1, 12, 48, 0, 0)) # set a specific date and time
235+
rtc.datetime() # get date and time
236+
226237
Deep-sleep mode
227238
---------------
228239

‎docs/library/network.rst

Lines changed: 24 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -72,8 +72,7 @@ parameter should be `id`.
7272
connection parameters. For various medium types, there are different
7373
sets of predefined/recommended parameters, among them:
7474

75-
* WiFi: *bssid* keyword to connect by BSSID (MAC address) instead
76-
of access point name
75+
* WiFi: *bssid* keyword to connect to a specific BSSID (MAC address)
7776

7877
.. method:: disconnect()
7978

@@ -225,7 +224,9 @@ parameter should be `id`.
225224
==============
226225

227226
This class allows you to control WIZnet5x00 Ethernet adaptors based on
228-
the W5200 and W5500 chipsets (only W5200 tested).
227+
the W5200 and W5500 chipsets. The particular chipset that is supported
228+
by the firmware is selected at compile-time via the MICROPY_PY_WIZNET5K
229+
option.
229230

230231
Example usage::
231232
@@ -269,6 +270,11 @@ parameter should be `id`.
269270
Methods
270271
-------
271272

273+
.. method:: wiznet5k.isconnected()
274+
275+
Returns ``True`` if the physical Ethernet link is connected and up.
276+
Returns ``False`` otherwise.
277+
272278
.. method:: wiznet5k.ifconfig([(ip, subnet, gateway, dns)])
273279

274280
Get/set IP address, subnet mask, gateway and DNS.
@@ -333,9 +339,12 @@ parameter should be `id`.
333339
argument is passed. Otherwise, query current state if no argument is
334340
provided. Most other methods require active interface.
335341

336-
.. method:: wlan.connect(ssid, password)
342+
.. method:: wlan.connect(ssid=None, password=None, \*, bssid=None)
337343

338344
Connect to the specified wireless network, using the specified password.
345+
If *bssid* is given then the connection will be restricted to the
346+
access-point with that MAC address (the *ssid* must also be specified
347+
in this case).
339348

340349
.. method:: wlan.disconnect()
341350

@@ -413,16 +422,17 @@ parameter should be `id`.
413422
Following are commonly supported parameters (availability of a specific parameter
414423
depends on network technology type, driver, and `MicroPython port`).
415424

416-
========= ===========
417-
Parameter Description
418-
========= ===========
419-
mac MAC address (bytes)
420-
essid WiFi access point name (string)
421-
channel WiFi channel (integer)
422-
hidden Whether ESSID is hidden (boolean)
423-
authmode Authentication mode supported (enumeration, see module constants)
424-
password Access password (string)
425-
========= ===========
425+
============= ===========
426+
Parameter Description
427+
============= ===========
428+
mac MAC address (bytes)
429+
essid WiFi access point name (string)
430+
channel WiFi channel (integer)
431+
hidden Whether ESSID is hidden (boolean)
432+
authmode Authentication mode supported (enumeration, see module constants)
433+
password Access password (string)
434+
dhcp_hostname The DHCP hostname to use
435+
============= ===========
426436

427437

428438

‎docs/library/pyb.Accel.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
.. currentmodule:: pyb
2+
.. _pyb.Accel:
23

34
class Accel -- accelerometer control
45
====================================

‎docs/library/pyb.CAN.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
.. currentmodule:: pyb
2+
.. _pyb.CAN:
23

34
class CAN -- controller area network communication bus
45
======================================================

‎docs/library/pyb.LCD.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
.. currentmodule:: pyb
2+
.. _pyb.LCD:
23

34
class LCD -- LCD control for the LCD touch-sensor pyskin
45
========================================================

‎docs/library/pyb.Switch.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
.. currentmodule:: pyb
2+
.. _pyb.Switch:
23

34
class Switch -- switch object
45
=============================

‎docs/library/pyb.USB_HID.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
.. currentmodule:: pyb
2+
.. _pyb.USB_HID:
23

34
class USB_HID -- USB Human Interface Device (HID)
45
=================================================

‎docs/library/pyb.USB_VCP.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
.. currentmodule:: pyb
2+
.. _pyb.USB_VCP:
23

34
class USB_VCP -- USB virtual comm port
45
======================================

‎docs/library/ure.rst

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,8 @@ Supported operators are:
3434

3535
``'+?'``
3636

37+
``'|'``
38+
3739
``'()'``
3840
Grouping. Each group is capturing (a substring it captures can be accessed
3941
with `match.group()` method).

0 commit comments

Comments
 (0)