Issue following your steps

[kokkiat]

Hi,

There are this issue following your steps in github.

I git clone the 2 projects and then run go mod tidy and got the following issue.

[ec2-user@ip-10-0-5-88 lkm]$ go mod tidy
go: github.com/lkmio/lkm imports
github.com/lkmio/transport: github.com/lkmio/transport@v0.0.0: replacement directory ../transport does not exist
go: github.com/lkmio/lkm/flv imports
github.com/lkmio/flv: github.com/lkmio/flv@v0.0.0: replacement directory ../flv does not exist
go: github.com/lkmio/lkm/flv imports
github.com/lkmio/flv/amf0: github.com/lkmio/flv@v0.0.0: replacement directory ../flv does not exist
go: github.com/lkmio/lkm/gb28181 imports
github.com/lkmio/mpeg: github.com/lkmio/mpeg@v0.0.0: replacement directory ../mpeg does not exist
go: github.com/lkmio/lkm/gb28181 imports
github.com/lkmio/rtp: github.com/lkmio/rtp@v0.0.0: replacement directory ../rtp does not exist
go: github.com/lkmio/lkm/rtmp imports
github.com/lkmio/rtmp: github.com/lkmio/rtmp@v0.0.0: replacement directory ../rtmp does not exist
go: github.com/lkmio/lkm imports
go.uber.org/zap/zapcore tested by
go.uber.org/zap/zapcore.test imports
go.uber.org/goleak: github.com/lkmio/flv@v0.0.0 (replaced by ../flv): reading ../flv/go.mod: open /home/ec2-user/flv/go.mod: no such file or directory
go: github.com/lkmio/lkm/log imports
github.com/natefinch/lumberjack tested by
github.com/natefinch/lumberjack.test imports
gopkg.in/yaml.v2: github.com/lkmio/flv@v0.0.0 (replaced by ../flv): reading ../flv/go.mod: open /home/ec2-user/flv/go.mod: no such file or directory
go: github.com/lkmio/lkm/log imports
github.com/x-cray/logrus-prefixed-formatter tested by
github.com/x-cray/logrus-prefixed-formatter.test imports
github.com/onsi/ginkgo: github.com/lkmio/flv@v0.0.0 (replaced by ../flv): reading ../flv/go.mod: open /home/ec2-user/flv/go.mod: no such file or directory
go: github.com/lkmio/lkm/log imports
github.com/x-cray/logrus-prefixed-formatter tested by
github.com/x-cray/logrus-prefixed-formatter.test imports
github.com/onsi/gomega: github.com/lkmio/flv@v0.0.0 (replaced by ../flv): reading ../flv/go.mod: open /home/ec2-user/flv/go.mod: no such file or directory
go: github.com/lkmio/lkm/rtc imports
github.com/pion/webrtc/v3 imports
github.com/pion/datachannel tested by
github.com/pion/datachannel.test imports
github.com/pion/transport/test: github.com/lkmio/flv@v0.0.0 (replaced by ../flv): reading ../flv/go.mod: open /home/ec2-user/flv/go.mod: no such file or directory
go: github.com/lkmio/lkm/rtc imports
github.com/pion/webrtc/v3 imports
github.com/pion/interceptor/pkg/twcc tested by
github.com/pion/interceptor/pkg/twcc.test imports
github.com/pion/transport/v3/test: github.com/lkmio/flv@v0.0.0 (replaced by ../flv): reading ../flv/go.mod: open /home/ec2-user/flv/go.mod: no such file or directory
go: github.com/lkmio/lkm/rtc imports
github.com/pion/webrtc/v3 imports
github.com/pion/sctp tested by
github.com/pion/sctp.test imports
github.com/pion/transport/v3/vnet: github.com/lkmio/flv@v0.0.0 (replaced by ../flv): reading ../flv/go.mod: open /home/ec2-user/flv/go.mod: no such file or directory
go: github.com/lkmio/lkm imports
go.uber.org/zap/zapcore tested by
go.uber.org/zap/zapcore.test imports
gopkg.in/yaml.v3 tested by
gopkg.in/yaml.v3.test imports
gopkg.in/check.v1: github.com/lkmio/flv@v0.0.0 (replaced by ../flv): reading ../flv/go.mod: open /home/ec2-user/flv/go.mod: no such file or directory

[ydajiang]

Currently, the avformat, mpeg, flv, rtmp, transport, and rtp dependency libraries in go mod are imported using source code, and the release version has not been released yet. You need to manually download these dependency libraries to the same directory as lkm and then compile them.

[kokkiat]

Hi,

Thanks for the quick reply. Currently all the libraries in the same folder, but I'm still having issue.

current folder structure
-rw-rw-r-- 1 ec2-user ec2-user 7084 Mei 29 02:09 api_gb.go
-rw-rw-r-- 1 ec2-user ec2-user 13956 Mei 29 02:09 api.go
-rw-rw-r-- 1 ec2-user ec2-user 1955 Mei 29 02:09 args.go
drwxrwxr-x 8 ec2-user ec2-user 4096 Mei 29 03:27 avformat
-rw-rw-r-- 1 ec2-user ec2-user 1538 Mei 29 02:09 bridge.go
-rwxrw-r-- 1 ec2-user ec2-user 1710 Mei 29 03:31 build_docker_images.sh
-rw-rw-r-- 1 ec2-user ec2-user 1636 Mei 29 02:09 config.json
-rw-rw-r-- 1 ec2-user ec2-user 1310 Mei 29 02:56 Dockerfile
drwxrwxr-x 4 ec2-user ec2-user 250 Mei 29 03:27 flv
drwxrwxr-x 2 ec2-user ec2-user 4096 Mei 29 02:09 gb28181
-rw-rw-r-- 1 ec2-user ec2-user 2103 Mei 29 03:13 go.mod
-rw-rw-r-- 1 ec2-user ec2-user 21233 Mei 29 02:21 go.sum
drwxrwxr-x 2 ec2-user ec2-user 46 Mei 29 02:09 hls
-rw-rw-r-- 1 ec2-user ec2-user 2433 Mei 29 02:09 http_json_body_decode.go
-rw-rw-r-- 1 ec2-user ec2-user 786 Mei 29 02:09 http_response.go
drwxrwxr-x 2 ec2-user ec2-user 106 Mei 29 02:09 jt1078
-rw-rw-r-- 1 ec2-user ec2-user 1062 Mei 29 02:09 LICENSE
-rwxrwxr-x 1 ec2-user ec2-user 20252627 Mei 29 02:21 lkm
drwxrwxr-x 2 ec2-user ec2-user 37 Mei 29 02:09 log
-rw-rw-r-- 1 ec2-user ec2-user 5342 Mei 29 02:09 main.go
-rw-rw-r-- 1 ec2-user ec2-user 2389 Mei 29 02:09 Makefile
drwxrwxr-x 3 ec2-user ec2-user 4096 Mei 29 03:29 mpeg
-rw-rw-r-- 1 ec2-user ec2-user 3187 Mei 29 02:09 README.md
drwxrwxr-x 2 ec2-user ec2-user 27 Mei 29 02:09 record
drwxrwxr-x 2 ec2-user ec2-user 46 Mei 29 02:09 rtc
drwxrwxr-x 3 ec2-user ec2-user 325 Mei 29 03:28 rtmp
drwxrwxr-x 3 ec2-user ec2-user 172 Mei 29 03:28 rtp
drwxrwxr-x 2 ec2-user ec2-user 158 Mei 29 02:09 rtsp
drwxrwxr-x 2 ec2-user ec2-user 4096 Mei 29 02:09 stream
drwxrwxr-x 2 ec2-user ec2-user 27 Mei 29 02:09 transcode
drwxrwxr-x 3 ec2-user ec2-user 4096 Mei 29 02:51 transport
drwxrwxr-x 6 ec2-user ec2-user 96 Mei 29 02:21 vendor
drwxrwxr-x 2 ec2-user ec2-user 59 Mei 29 02:09 web

the Dockerfile
FROM golang:1.19-alpine as builder

设置构建参数

ARG GOOS=linux
ARG GOARCH=amd64

输出参数值以便调试

RUN echo "Building for GOOS: $GOOS and GOARCH: $GOARCH"

设置必要的环境变量

ENV GO111MODULE=on
CGO_ENABLED=0
GOOS=$GOOS
GOARCH=$GOARCH
GOPROXY=https://goproxy.cn,direct

RUN set -ex
&& sed -i 's/dl-cdn.alpinelinux.org/mirrors.aliyun.com/g' /etc/apk/repositories
&& apk --update add tzdata git
&& cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
&& apk --no-cache add ca-certificates

移动到工作目录：/build

WORKDIR /build/lkm

将代码复制到容器中

COPY . .

COPY ./avformat /build/avformat
COPY ./mpeg /build/mpeg
COPY ./flv /build/flv
COPY ./transport /build/transport
COPY ./rtmp /build/rtmp
COPY ./rtp /build/rtp

RUN go mod download && go mod tidy -v && go build -o lkm .

运行阶段指定scratch作为基础镜像

FROM scratch

WORKDIR /app

拷贝二进制可执行文件

COPY --from=builder /build/lkm/lkm lkm

COPY --from=builder /build/lkm/config.json config.json

下载时区包

COPY --from=builder /usr/share/zoneinfo /usr/share/zoneinfo

设置当前时区

COPY --from=builder /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

需要运行的命令

ENTRYPOINT ["./lkm"

the build file
FROM golang:1.19-alpine as builder

设置构建参数

ARG GOOS=linux
ARG GOARCH=amd64

输出参数值以便调试

RUN echo "Building for GOOS: $GOOS and GOARCH: $GOARCH"

设置必要的环境变量

ENV GO111MODULE=on
CGO_ENABLED=0
GOOS=$GOOS
GOARCH=$GOARCH
GOPROXY=https://goproxy.cn,direct

RUN set -ex
&& sed -i 's/dl-cdn.alpinelinux.org/mirrors.aliyun.com/g' /etc/apk/repositories
&& apk --update add tzdata git
&& cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
&& apk --no-cache add ca-certificates

移动到工作目录：/build

WORKDIR /build/lkm

将代码复制到容器中

COPY . .

COPY ./avformat /build/avformat
COPY ./mpeg /build/mpeg
COPY ./flv /build/flv
COPY ./transport /build/transport
COPY ./rtmp /build/rtmp
COPY ./rtp /build/rtp

RUN go mod download && go mod tidy -v && go build -o lkm .

运行阶段指定scratch作为基础镜像

FROM scratch

WORKDIR /app

拷贝二进制可执行文件

COPY --from=builder /build/lkm/lkm lkm

COPY --from=builder /build/lkm/config.json config.json

下载时区包

COPY --from=builder /usr/share/zoneinfo /usr/share/zoneinfo

设置当前时区

COPY --from=builder /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

需要运行的命令

ENTRYPOINT ["./lkm"]

[ec2-user@ip-10-0-5-88 lkm]$ cat build_docker_images.sh
#!/bin/bash

默认的 GOOS 和 GOARCH 值

DEFAULT_GOOS="linux"
DEFAULT_GOARCH="amd64"

初始化 GOOS 和 GOARCH 变量

GOOS=""
GOARCH=""

解析命令行参数

while [ $# -gt 0 ]; do
case "$1" in
=) # 如果参数是键值对形式
key="${1%%=}" # 提取键
value="${1#=}" # 提取值
case "$key" in
GOOS) GOOS="$value" ;; # 如果键是 GOOS，则设置 GOOS
GOARCH) GOARCH="$value" ;; # 如果键是 GOARCH，则设置 GOARCH
*) echo "Unknown parameter: $key" ;;
esac
shift
;;
*) # 如果参数不是键值对形式
echo "Usage: $0 [GOOS=operating_system] [GOARCH=architecture]"
exit 1
;;
esac
done

如果没有通过命令行参数设置 GOOS，则尝试从 go env 读取

if [ -z "$GOOS" ]; then
GOOS=$(go env GOOS 2>/dev/null)

如果 go env 失败，则使用默认值

if [ -z "$GOOS" ]; then
GOOS="$DEFAULT_GOOS"
fi
fi

如果没有通过命令行参数设置 GOARCH，则尝试从 go env 读取

if [ -z "$GOARCH" ]; then
GOARCH=$(go env GOARCH 2>/dev/null)

如果 go env 失败，则使用默认值

if [ -z "$GOARCH" ]; then
GOARCH="$DEFAULT_GOARCH"
fi
fi

输出 GOOS 和 GOARCH 的值

echo "The value of GOOS is: $GOOS"
echo "The value of GOARCH is: $GOARCH"

#cp ../avformat ./ -r
rsync -a --exclude='.git' ../avformat/ ./avformat
#cp ../flv ./ -r
rsync -a --exclude='.git' ../flv/ ./flv
#cp ../mpeg ./ -r
rsync -a --exclude='.git' ../mpeg/ ./mpeg
#cp ../rtp ./ -r
rsync -a --exclude='.git' ../rtp/ ./rtp
#cp ../rtmp ./ -r
rsync -a --exclude='.git' ../rtmp/ ./rtmp

docker build --build-arg GOOS=$GOOS --build-arg GOARCH=$GOARCH -t lkm .

Issue during docker build
8.290 github.com/lkmio/lkm imports
8.290 github.com/lkmio/lkm/flv: no matching versions for query "latest"
8.290 github.com/lkmio/lkm imports
8.290 github.com/lkmio/lkm/rtmp: no matching versions for query "latest"

Dockerfile:37

35 | COPY ./rtp /build/rtp
36 |
37 | >>> RUN go mod download && go mod tidy -v && go build -o lkm .
38 |
39 | # 运行阶段指定scratch作为基础镜像

ERROR: failed to solve: process "/bin/sh -c go mod download && go mod tidy -v && go build -o lkm ." did not complete successfully: exit code: 1

Hope to hear from you soon. Thank you.

[kokkiat]

the go.mod file

module github.com/lkmio/lkm

require (
github.com/lkmio/flv v0.0.0
github.com/lkmio/mpeg v0.0.0
github.com/lkmio/rtmp v0.0.0
github.com/lkmio/rtp v0.0.0
github.com/lkmio/transport v0.0.0
)

require (
github.com/gorilla/mux v1.8.1
github.com/gorilla/websocket v1.5.1
github.com/lkmio/avformat v0.0.0
github.com/natefinch/lumberjack v2.0.0+incompatible
github.com/pion/interceptor v0.1.25
github.com/pion/rtcp v1.2.12
github.com/pion/rtp v1.8.5
github.com/pion/sdp/v3 v3.0.8
github.com/pion/webrtc/v3 v3.2.29
github.com/sirupsen/logrus v1.9.3
github.com/x-cray/logrus-prefixed-formatter v0.5.2
go.uber.org/zap v1.27.0
)

require (
github.com/BurntSushi/toml v1.3.2 // indirect
github.com/davecgh/go-spew v1.1.1 // indirect
github.com/google/uuid v1.3.1 // indirect
github.com/mattn/go-colorable v0.1.13 // indirect
github.com/mattn/go-isatty v0.0.16 // indirect
github.com/mgutz/ansi v0.0.0-20200706080929-d51e80ef957d // indirect
github.com/pion/datachannel v1.5.5 // indirect
github.com/pion/dtls/v2 v2.2.7 // indirect
github.com/pion/ice/v2 v2.3.13 // indirect
github.com/pion/logging v0.2.2 // indirect
github.com/pion/mdns v0.0.12 // indirect
github.com/pion/randutil v0.1.0 // indirect
github.com/pion/sctp v1.8.12 // indirect
github.com/pion/srtp/v2 v2.0.18 // indirect
github.com/pion/stun v0.6.1 // indirect
github.com/pion/transport/v2 v2.2.3 // indirect
github.com/pion/turn/v2 v2.1.3 // indirect
github.com/pmezard/go-difflib v1.0.0 // indirect
github.com/stretchr/testify v1.9.0 // indirect
go.uber.org/multierr v1.10.0 // indirect
golang.org/x/crypto v0.18.0 // indirect
golang.org/x/net v0.20.0 // indirect
golang.org/x/sys v0.16.0 // indirect
golang.org/x/term v0.16.0 // indirect
gopkg.in/natefinch/lumberjack.v2 v2.2.1 // indirect
gopkg.in/yaml.v3 v3.0.1 // indirect
)

replace github.com/lkmio/avformat => ../avformat

replace github.com/lkmio/mpeg => ../mpeg

replace github.com/lkmio/flv => ../flv

replace github.com/lkmio/rtmp => ../rtmp

replace github.com/lkmio/transport => ../transport

replace github.com/lkmio/rtp => ../rtp

go 1.19

[kokkiat]

Hi,
I manage to build after updating your code import in main.go
from "github.com/lkmio/lkm/flv" => "github.com/lkmio/flv"
from "github.com/lkmio/lkm/rtmp" => "github.com/lkmio/rtmp"

api.go
from "github.com/lkmio/lkm/flv" => "github.com/lkmio/flv"

bridge.go
from "github.com/lkmio/lkm/flv" => "github.com/lkmio/flv"

flv/http_flv.go
from "github.com/lkmio/lkm/rtmp" => "github.com/lkmio/rtmp"

however, having this error now.

31.24 # github.com/lkmio/lkm
31.24 ./api.go:171:14: undefined: flv.NewFLVSink
31.24 ./api.go:171:73: undefined: flv.NewWSConn
31.24 ./api.go:211:14: undefined: flv.NewFLVSink
31.24 ./bridge.go:49:32: undefined: flv.TransStream
31.24 ./main.go:26:65: undefined: rtmp.TransStreamFactory
31.24 ./main.go:28:63: undefined: flv.TransStreamFactory
31.24 ./main.go:99:18: undefined: rtmp.NewServer

Dockerfile:37

35 | COPY ./rtp /build/rtp
36 |
37 | >>> RUN go mod download && go mod tidy -v && go build -o lkm .
38 |
39 | # 运行阶段指定scratch作为基础镜像

ERROR: failed to solve: process "/bin/sh -c go mod download && go mod tidy -v && go build -o lkm ." did not complete successfully: exit code: 1

[ydajiang]

Maybe I didn't express it clearly just now. This is my directory:
drwxr-xr-x 4 root root 174 Apr 18 03:10 flv
drwxr-xr-x 16 root root 4096 May 14 08:46 lkm
drwxr-xr-x 3 root root 4096 Apr 30 09:30 mpeg
drw-r--r-- 3 root root 34 May 14 12:06 record
drwxr-xr-x 3 root root 163 Apr 18 03:10 rtmp
drwxr-xr-x 3 root root 172 Apr 18 03:10 rtp
drwxr-xr-x 3 root root 4096 May 14 08:12 transport
Following this directory can solve your problem. Or change ../library in go mod to ./library.

[kokkiat]

drwxrwxr-x 8 ec2-user ec2-user 4096 Mei 29 02:09 avformat
drwxrwxr-x 4 ec2-user ec2-user 174 Mei 29 02:20 flv
drwxrwxr-x 3 ec2-user ec2-user 17 Mei 28 08:43 go
drwxrwxr-x 20 ec2-user ec2-user 4096 Mei 29 04:05 lkm
drwxrwxr-x 3 ec2-user ec2-user 4096 Mei 29 02:20 mpeg
drwxrwxr-x 3 ec2-user ec2-user 163 Mei 29 02:20 rtmp
drwxrwxr-x 3 ec2-user ec2-user 172 Mei 29 02:20 rtp
drwxrwxr-x 3 ec2-user ec2-user 4096 Mei 29 02:20 transport

I did exactly like this when I first started and then
cd lkm
and ran your
./build_docker_images.sh

after that had issue.
it will be great if you can share your build steps.

and btw, there is no ../library or ./library in your go.mod file.

[kokkiat]

ok, i manage to build and run manually, but not able to build from docker. Thanks anyway.

[ydajiang]

The project has been refactored, but the Dockerfile is still built the same way as before. Comment out "COPY ./avformat /build/avformat". Copy the manually downloaded dependency libraries to /bulid, for example:
COPY ../rtp /build/rtp
COPY ../mepg /build/mepg
....
New features are being developed recently, and the problem will be fixed later.

[kokkiat]

I manage the get the docker running.
One question though, how do I simulate jt1078 stream in to the server and then stream out through rtmp?

[ydajiang]

Take a look at this test case

lkm/jt1078/jt_test.go

Line 57 in 61e152e

t.Run("publish", func(t *testing.T) {